-- Logs begin at Thu 2022-07-21 04:59:27 UTC, end at Thu 2022-07-21 06:15:38 UTC. -- Jul 21 05:35:01.208383 dv-cinder-850449-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 05:35:01.216664 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 05:35:01 2022] *** Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: nodename: dv-cinder-850449-1-iscsi Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: machine: x86_64 Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: clock source: unix Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: pcre jit disabled Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: detected number of CPU cores: 4 Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: current working directory: / Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: detected binary path: /usr/bin/uwsgi-core Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: your processes number limit is 47680 Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: your memory page size is 4096 bytes Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: detected max file descriptor number: 2048 Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: lock engine: pthread robust mutexes Jul 21 05:35:01.220083 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: thunder lock: enabled Jul 21 05:35:01.220914 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 05:35:01.220914 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 05:35:01.263241 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: Python main interpreter initialized at 0x5607b36d89c0 Jul 21 05:35:01.263241 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: python threads support enabled Jul 21 05:35:01.263241 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: your server socket listen backlog is limited to 100 connections Jul 21 05:35:01.263241 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: your mercy for graceful operations on workers is 90 seconds Jul 21 05:35:01.263595 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 05:35:01.263678 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: *** Operational MODE: preforking *** Jul 21 05:35:01.263906 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: *** uWSGI is running in multiple interpreter mode *** Jul 21 05:35:01.263906 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: spawned uWSGI master process (pid: 109839) Jul 21 05:35:01.264101 dv-cinder-850449-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 05:35:01.265859 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: spawned uWSGI worker 1 (pid: 109840, cores: 1) Jul 21 05:35:01.265859 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: spawned uWSGI worker 2 (pid: 109841, cores: 1) Jul 21 05:35:01.265859 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 05:35:01.926600 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 05:35:01.927217 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 05:35:03.030740 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:35:03.030740 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: from cryptography.utils import int_from_bytes Jul 21 05:35:03.031466 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:35:03.031466 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: from cryptography.utils import int_from_bytes Jul 21 05:35:03.039036 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:35:03.039036 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: from cryptography.utils import int_from_bytes Jul 21 05:35:03.039488 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:35:03.039488 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: from cryptography.utils import int_from_bytes Jul 21 05:35:05.491027 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 05:35:05.491633 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 05:35:05.491774 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 05:35:05.492162 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 05:35:05.492414 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 05:35:05.492803 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.493124 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.493442 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.493759 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.494067 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.494398 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.494711 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.495041 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.495374 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.495614 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.495923 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.496246 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850449-1-iscsi {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.496562 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.496860 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.497163 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.497479 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.497775 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.498102 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.498402 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.498896 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.499332 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.499637 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.499946 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.500277 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.500617 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.500924 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.501239 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.501546 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.501632 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 05:35:05.501998 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 05:35:05.502076 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.502168 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.502340 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 05:35:05.502544 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850449-1-iscsi {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.502701 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 05:35:05.502859 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.502951 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 05:35:05.503193 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.503349 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.503507 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.503671 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.503917 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.504002 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.504227 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.504346 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.504541 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.504654 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.504857 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.504942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.505191 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.505284 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.505497 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.505583 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.505821 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.505917 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.506078 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.506171 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.506388 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.506483 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.506709 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850449-1-iscsi {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.506794 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.507046 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.507134 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.507355 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.507440 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.507658 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.507752 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.507972 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.508079 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.508275 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.508361 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.508576 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.508659 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.508828 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.508927 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.509135 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.509362 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.509466 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.509668 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.509754 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.509968 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.510055 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.510271 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.510374 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.510539 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.510631 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.510855 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.510946 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.511198 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.511308 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.511509 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.511594 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.511810 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.511907 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.512111 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.512195 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.512418 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.512509 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.512724 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.512825 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850449-1-iscsi {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.513030 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.513116 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.513335 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.513420 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.513640 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.513734 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.513956 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.514075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.514274 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.514407 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.514603 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.514691 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.514891 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.515003 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.515231 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.515343 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.515608 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.515707 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.515859 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.515955 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.516218 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.516356 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.516554 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.516643 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.516870 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.516956 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.517176 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.517274 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.517490 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.517576 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.517796 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.517882 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.518106 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.518201 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.518409 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.518497 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.518707 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.518800 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.518954 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.519084 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.519292 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.519381 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.519613 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.519700 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.519884 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.519971 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.520182 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.520269 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.520469 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.520563 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.520715 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.520804 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.521029 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.521116 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.521346 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.521442 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.521651 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.521738 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.521946 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.522040 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.522246 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.522345 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.522546 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.522694 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.522846 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.522939 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.523170 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.523271 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.523477 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.523578 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.523778 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.523873 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.524080 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.524178 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.524383 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.524478 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.524722 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.524816 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525005 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525106 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525306 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525409 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525610 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525700 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525911 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.525999 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.526213 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.526311 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.526518 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.526606 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.526833 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.526922 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.527158 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.527251 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.527462 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.527549 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.527777 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.527865 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.528083 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.528168 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.528384 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.528483 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.528689 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.528777 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.528990 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.529075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.529293 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.529379 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.529610 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.529725 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.529857 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.529957 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.530156 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.530253 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.530459 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.530546 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.530774 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.530862 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.531093 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.531197 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.531395 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.531482 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.531712 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.531809 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.532013 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.532108 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.532315 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.532407 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.532612 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.532706 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.532913 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.533010 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.533208 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.533296 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.533510 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.533603 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.533814 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.533902 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.534115 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.534202 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.534414 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.534500 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.534713 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.534802 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.535113 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.535219 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.535354 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.535450 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.536006 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.536099 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.536310 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.536406 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.536613 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.536710 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.536917 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.537004 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.537236 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.537330 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.537539 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.537627 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.537841 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.537929 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.538161 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.538248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.538462 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.538557 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.538760 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.538848 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.539099 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.539192 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.539407 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.539512 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.539711 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.539799 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.540023 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.540108 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.540318 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.540420 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.540620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.540708 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.540931 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.541018 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.541235 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.541403 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.541537 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.541625 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.541836 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.541923 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.542133 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.542230 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.542433 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.542520 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.542733 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.542829 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.543052 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.543155 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.543349 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.543437 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.543646 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.543739 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.543958 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.544058 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.544275 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.544362 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.544581 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.544707 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.544884 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.545007 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.545221 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.545334 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.545497 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:35:05.545586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.545819 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.545915 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.546130 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.546227 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.546443 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.546532 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.546754 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.546849 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.547084 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.547177 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.547448 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.547544 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.547759 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.547847 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.548074 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.548198 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.548404 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.548505 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.548716 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.548810 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.549022 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.549121 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.549331 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.549426 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.549637 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.549724 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.549947 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.550032 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.550257 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.550358 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.550565 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.550652 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.550867 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.550955 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.551206 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.551306 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.551512 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.551597 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.551819 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.551907 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.552121 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.552207 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.552441 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.552536 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.552755 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.552849 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.553059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.553145 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.553388 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.553483 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.553694 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.553782 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.554004 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.554092 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.554315 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.554403 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.554626 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.554720 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.554931 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.555079 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.555332 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.555448 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.555569 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.555672 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.555872 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.555959 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.556194 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.556290 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.556505 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.556600 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.556813 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.556901 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.557121 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.557214 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.557428 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.557527 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.557730 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.557817 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.558046 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.558134 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.558357 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.558455 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.558666 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.558761 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.558981 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.559090 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.559314 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.559403 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.559620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.559713 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.559932 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.560030 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.560239 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.560328 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.560549 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.560636 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.560857 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.560953 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.561158 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.561247 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.561458 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.561558 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.561759 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.561856 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.562062 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.562190 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.562360 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.562448 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.562675 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.562771 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.563003 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.563109 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.563337 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.563424 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.563640 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.563808 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.563951 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.564039 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.564254 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.564342 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.564557 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.564652 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.564856 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.564948 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.565154 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.565240 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.565457 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.565565 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.565756 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.565843 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.566056 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.566143 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.566359 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.566455 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.566665 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.566819 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.566963 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.567082 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.567307 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.567395 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.567612 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.567699 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.567912 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.568000 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.568223 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.568318 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.568532 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.568629 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.568837 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.568925 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.569145 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.569234 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.569452 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.569553 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.569771 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.569865 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.570075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.570161 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.570382 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.570469 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.570693 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.570790 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.571045 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.571136 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.571336 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.571422 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.571651 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.571750 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.571959 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.572047 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.572268 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.572354 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.572567 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.572664 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.572871 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.572959 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.573170 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.573257 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.573471 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.573570 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.573769 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.573857 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.574073 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.574160 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.574372 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.574476 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.574670 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.574758 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.574966 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.575082 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.575289 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.575386 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.575589 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.575695 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.575905 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.576000 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.576209 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.576299 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.576507 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.576595 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.576806 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.576912 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.577105 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.577193 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.577420 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.577505 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.577725 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.577820 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.578047 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.578134 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.578354 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.578441 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.578722 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.578827 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.579066 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.579159 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.579356 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.579463 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.579679 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.579779 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.580008 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.580103 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.580315 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.580403 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.580625 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.580726 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.580942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.581036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.581246 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.581332 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.581550 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.581643 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.581855 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.581941 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.582158 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.582243 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.582461 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.582547 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.582767 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.582866 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.583099 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.583205 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.583503 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.583605 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.583708 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.583794 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.584013 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.584101 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.584327 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.584416 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.584636 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.584723 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.584940 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.585036 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.585242 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.585335 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.585548 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.585756 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.585843 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.585933 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.586147 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.586236 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.586454 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.586550 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.586760 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.586862 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.587087 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.587196 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.587394 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.587491 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.587706 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.587803 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.588014 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.588101 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.588316 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.588401 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.588617 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.588714 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.588918 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.589009 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.589214 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.589301 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.589522 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.589619 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.589838 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.589924 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.590154 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.590241 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.590456 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.590542 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.590764 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.590851 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.591096 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.591203 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.591400 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.591489 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.591705 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.591791 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.592008 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.592097 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.592308 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.592398 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.592606 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.592694 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.592906 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.593003 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.593212 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.593306 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.593511 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.593605 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.593813 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.593909 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.594110 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.594205 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.594441 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.594536 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.594743 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.594849 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.595060 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.595164 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.595365 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.595455 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.595670 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.595886 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.595987 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.596069 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.596275 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.596546 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.596643 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.596884 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.596980 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.597178 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.597272 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.597479 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.597576 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.597789 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.597877 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.598095 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.598189 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.598394 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.598490 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.598690 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.598821 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.598984 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.599137 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.599344 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.599443 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.599648 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.599736 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.599947 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.600034 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.600255 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.600343 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.600567 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.600664 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.600868 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.600963 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.601172 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.601258 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.601473 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.601566 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.601772 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.601866 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.602073 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.602175 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.602377 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.602473 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.602675 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.602760 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.602974 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.603091 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.603299 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.603386 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.603598 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.603692 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.603898 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.603999 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.604199 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.604288 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.604500 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.604586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.604806 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.604908 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.605105 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.605199 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.605399 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.605485 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.605697 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.605798 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.606005 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.606105 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.606323 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.606553 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.606655 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.606886 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.606973 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.607222 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.607311 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.607537 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.607639 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.607858 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.607946 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.608171 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.608257 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.608496 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.608582 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.608800 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.608882 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.609101 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.609188 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.609410 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.609507 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.609714 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.609801 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.610064 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.610161 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.610364 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.610460 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.610669 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.610755 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.610968 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.611095 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.611294 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.611392 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.611593 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.611680 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.611894 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.611980 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.612191 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.612286 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.612486 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.612573 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.612783 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.612870 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.613081 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.613176 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.613381 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.613469 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.613676 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.613763 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.613979 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.614065 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.614275 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.614360 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.614578 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.614664 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.614878 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.614966 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.615202 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.615292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.615501 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.615589 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.615799 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.615889 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.616098 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.616236 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.616428 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.616568 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.616712 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.616849 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.617001 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.617136 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.617300 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.617444 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.617608 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.617745 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.617919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.618054 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.618222 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.618365 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.618510 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.618646 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.618814 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.618957 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.619136 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.619295 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.619429 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.619563 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.619698 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.619832 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.619976 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.620119 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.620283 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.620420 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.620587 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.620725 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.620880 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.621017 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.621158 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.621291 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.621459 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.621595 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.621759 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.621897 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.622060 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.622211 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.622344 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.622478 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.622646 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.622793 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.622944 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.623078 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.623273 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.623406 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.623576 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.623716 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.623876 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.624013 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.624155 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.624308 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.624462 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.624601 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.624793 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.624887 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.625057 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.625157 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.625356 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.625466 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.625678 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.625770 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.625977 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.626108 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.626278 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.626369 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.626579 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.626667 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.626876 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.626973 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.627218 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.627309 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.627523 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.627611 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.627820 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.627909 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.628122 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.628217 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.628425 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.628520 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.628723 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.628812 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.629021 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.629116 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.629321 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.629410 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.629641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.629761 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.629948 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.630044 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.630244 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.630339 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.630547 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.630634 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.630846 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.630932 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.631164 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.631267 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.631465 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.631551 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.631765 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.631850 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.632060 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.632159 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.632355 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.632440 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.632650 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.632737 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.632946 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.633045 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.633242 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.633327 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.633550 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.633635 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.633849 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.633942 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.634148 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.634233 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.634446 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.634532 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.634744 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.634829 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.635067 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.635155 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.635377 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.635464 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.635681 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.635786 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.635999 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.636103 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.636306 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.636399 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.636607 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.636701 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.636911 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.636996 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.637212 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.637297 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.637518 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.637611 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.637823 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.637908 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.638136 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.638245 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.638441 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.638554 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.638748 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.638862 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.639066 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.639179 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.639368 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.639488 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.639683 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.639797 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.639993 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.640114 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.640298 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.640425 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.640615 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.640707 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.640931 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.641173 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.641298 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.641489 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.641582 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.641800 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.641892 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.642111 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.642198 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.642414 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.642499 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.642714 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.642808 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.643035 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.643125 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.643363 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.643460 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.643665 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.643835 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.643967 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.644054 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.644270 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.644356 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.644575 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.644668 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.644878 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.644962 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.645180 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.645264 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.645486 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.645616 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.645814 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.645905 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.646107 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.646196 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.646412 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.646601 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.646696 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.646910 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.647055 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.647245 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.647346 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.647567 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.647653 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.647893 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.647986 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.648216 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.648345 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.648519 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.648640 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.648830 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.648943 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.649139 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.649233 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.649459 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.649544 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.649780 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.649891 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.650089 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.650202 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.650403 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.650513 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.650702 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.650814 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.651035 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.651127 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.651363 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.651450 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.651674 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.651759 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.651993 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.652088 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.652290 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.652404 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.652590 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.652725 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.652895 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.653034 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.653212 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.653353 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.653512 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.653675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.653812 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.653979 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.654142 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.654284 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.654410 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.654593 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.654708 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.654898 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.655039 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.655235 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.655451 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.655559 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.655758 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.655869 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.656063 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.656161 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.656500 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.656638 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.656814 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.656943 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.657126 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.657240 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.657428 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.657547 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.657749 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.657871 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.658055 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.658166 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.658359 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.658469 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.658668 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.658780 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.658973 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.659118 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.659318 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.659430 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.659619 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.659730 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.659931 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.660048 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.660236 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.660353 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.660867 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.660988 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.661179 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.661291 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.661893 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.661989 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.661989 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.662154 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.662241 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.662334 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.662425 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.662503 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.662728 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.662822 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.663076 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.663166 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.663389 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.663476 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.663705 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.663797 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.664009 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.664103 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.664311 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.664407 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.664616 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.664702 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.664916 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.665014 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.665216 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.665303 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.665514 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.665598 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.665820 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.665914 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.666128 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.666252 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.666431 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.666533 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.666732 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.666839 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.667047 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.667144 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.667347 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.667443 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.667646 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.667752 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.667951 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.668055 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.668266 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.668371 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.668565 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.668671 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.668877 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.668979 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.669181 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.669276 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.669478 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.669573 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.669777 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.669871 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.670078 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.670181 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.670374 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.670479 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.670672 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.670768 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.670971 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.671099 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.671330 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.671448 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.671630 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.671766 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.671952 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.672039 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.672251 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.672347 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.672603 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.672688 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.672910 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.673004 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.673222 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.673307 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.673536 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.673621 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.673843 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.673936 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.674155 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.674241 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.674466 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.674560 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.674763 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.674856 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.675085 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.675175 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.675392 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.675479 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.675693 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.675787 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.675990 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.676077 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.676290 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.676520 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.676618 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.676849 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.676938 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.677156 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.677241 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.677454 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.677548 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.677762 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.677847 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.678065 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.678148 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.678374 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.678467 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.678675 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.678759 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.678974 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.679096 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.679297 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.679402 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.679595 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.679690 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.679920 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.680006 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.680214 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.680301 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.680541 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.680628 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.680853 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.680939 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.681168 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.681255 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.681477 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.681575 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.681783 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.681880 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.682089 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.682183 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.682398 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.682483 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.682708 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.682875 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.683047 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.683139 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.683346 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.683431 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.683653 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.683751 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.683960 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.684052 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.684266 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.684351 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.684569 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.684663 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.684875 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.684968 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.685182 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.685268 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.685488 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.685574 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.685796 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.686015 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.686101 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.686343 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.686467 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.686654 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.686770 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.686960 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.687088 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.687295 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.687437 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.687602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.687748 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.687913 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.688135 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.688296 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.688483 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.688600 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.688904 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.689208 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.689333 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.689531 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.689849 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.689941 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.690166 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.690453 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.690539 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.690791 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.691090 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.691180 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.691420 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.691693 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.691803 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.692066 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.692248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.692375 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.692677 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.692843 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.692983 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.693291 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.693443 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.693600 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.693906 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.693991 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.694210 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.694512 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.694599 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.694820 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.695086 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.695232 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.695443 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.695575 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.695748 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.695981 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.696067 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.696381 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.696549 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.696691 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.697000 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.697097 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.697305 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.697580 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.697692 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.697916 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.698051 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.698434 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.698536 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.698742 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.699091 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.699417 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.699516 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.699735 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.700037 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.700124 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.700349 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.700632 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.700717 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.700975 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.701183 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.701307 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.701551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.701636 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.701853 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.701941 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.702148 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.702270 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.702453 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.702610 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.702758 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.702932 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.703077 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.703275 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.703397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.703627 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.703723 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.703952 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.704243 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.704330 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.704567 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.704653 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.704888 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.704985 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.705203 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.705297 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.705512 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.705605 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.705823 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.705921 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.706125 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.706211 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.706443 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.706536 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.706747 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.706884 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.707073 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.707161 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.707367 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.707454 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.707671 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.707760 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.707975 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.708063 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.708276 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.708369 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.708580 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.708667 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.708883 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.708977 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.709181 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.709268 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.709484 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.709577 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.709783 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.709868 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.710089 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.710187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.710393 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.710479 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.710690 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.710776 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.710991 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.711109 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.711321 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.711408 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.711623 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.711709 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.711922 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.712016 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.712225 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.712332 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.712524 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.712618 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.712829 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.712925 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.713128 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.713214 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.713429 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.713522 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.713728 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.713815 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.714032 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.714119 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.714331 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.714417 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.714632 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.714923 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.715036 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.715283 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.715397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.715604 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.715728 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.715904 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.716016 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.716211 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.716519 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.716835 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.717140 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.717427 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.717517 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.717748 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.717835 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.718066 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.718152 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.718377 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.718591 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.718712 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.718921 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.719073 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.719353 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.719442 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.719688 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.719774 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.720019 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.720125 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.720327 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.720413 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.720631 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.720718 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.720936 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.721023 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.721245 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.721330 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.721555 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.721642 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.721866 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.721951 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.722171 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.722378 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.722468 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.722547 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.722770 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.722872 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.723104 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.723199 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.723406 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.723502 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.723710 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.723797 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.724015 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.724102 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.724321 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.724420 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.724627 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.724723 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.724930 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.725028 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.725231 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.725329 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.725536 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.725635 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.725843 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.725936 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.726157 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.726259 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.726466 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.726597 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.726777 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.726911 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.727100 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.727190 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.727408 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.727517 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.727713 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.727832 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.728022 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.728152 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.728328 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.728476 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.728641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.728793 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.728967 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.729113 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.729277 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.729434 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.729580 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.729744 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.729990 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.730089 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.730297 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.730383 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.730618 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.730773 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.730936 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.731068 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.731272 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.731371 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.731591 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.731708 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.731906 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.732004 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.732212 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.732323 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.732740 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.732849 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.732924 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.732992 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.733127 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.733230 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.733435 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.733572 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.733737 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.733871 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.734039 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.734173 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.734347 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.734489 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.734630 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.734761 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.734966 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.735097 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.735296 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.735422 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.735600 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.735854 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.735938 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.736196 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.736291 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.736496 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.736693 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.736799 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.737099 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.737191 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.737401 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.737528 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.737701 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.737948 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.738033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.738296 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.738382 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.738601 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.738695 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.738907 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.739001 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.739232 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.739319 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.739532 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.739620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.739838 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.739936 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.740139 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.740226 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.740439 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.740525 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.740741 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.740848 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.741085 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.741184 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.741341 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.741427 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.741642 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.741742 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.741944 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.742032 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.742243 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.742337 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.742541 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.742675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.742839 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.742926 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.743190 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.743291 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.743518 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.743604 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.743827 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.743912 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.744135 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.744221 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.744441 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.744535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.744746 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.744833 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.745046 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.745131 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.745363 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.745456 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.745680 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.745766 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.745985 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.746077 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.746308 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.746402 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.746626 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.746713 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.746943 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.747061 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.747281 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.747371 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.747593 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.747687 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.747919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.748016 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.748231 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.748317 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.748537 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.748632 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.748851 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.748937 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.749162 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.749248 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.749463 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.749554 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.749778 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.749865 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.750089 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.750182 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.750400 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.750760 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.750907 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.751118 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.751352 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.751439 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.751760 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.751916 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.752070 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.752395 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.752488 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.752718 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.752805 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.753037 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.753125 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.754490 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.754601 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.754684 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.754764 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.754854 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.754935 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.755039 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.755123 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.755123 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.755123 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.755344 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.755426 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109840) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 05:35:05.755511 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.755735 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.756054 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.756384 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.756712 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.758505 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.760710 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.761069 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.761440 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.761780 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.762134 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.762473 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.762801 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.763162 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.763478 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:35:05.763727 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109841) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 05:35:05.816374 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO dbcounter [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Registered counter for database nova_api Jul 21 05:35:05.828485 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO dbcounter [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Registered counter for database nova_api Jul 21 05:35:05.933192 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_db.sqlalchemy.engines [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:05.940512 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writer thread running {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:05.943297 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_db.sqlalchemy.engines [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:05.949954 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writer thread running {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:05.994998 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.context [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c6f16-4900-4da5-aed7-50fb0037da9c(cell1) {{(pid=109840) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 05:35:05.998875 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:35:06.000506 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:35:06.001367 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:35:06.003475 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:35:06.004587 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.context [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c6f16-4900-4da5-aed7-50fb0037da9c(cell1) {{(pid=109841) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 05:35:06.005446 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO dbcounter [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Registered counter for database nova_cell0 Jul 21 05:35:06.008516 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_concurrency.lockutils [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:35:06.009296 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO dbcounter [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Registered counter for database nova_cell1 Jul 21 05:35:06.010110 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_concurrency.lockutils [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:35:06.010885 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_concurrency.lockutils [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:35:06.013016 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_concurrency.lockutils [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109841) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:35:06.014969 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO dbcounter [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Registered counter for database nova_cell0 Jul 21 05:35:06.017494 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_db.sqlalchemy.engines [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:06.019045 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO dbcounter [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Registered counter for database nova_cell1 Jul 21 05:35:06.019297 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_db.sqlalchemy.engines [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:06.026136 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_db.sqlalchemy.engines [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:06.026293 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writer thread running {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:06.026568 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writer thread running {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:06.030864 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writer thread running {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:06.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_db.sqlalchemy.engines [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:06.170332 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO dbcounter [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Registered counter for database nova_cell0 Jul 21 05:35:06.172250 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writer thread running {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:06.179838 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_db.sqlalchemy.engines [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109840) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:06.181710 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO dbcounter [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Registered counter for database nova_cell0 Jul 21 05:35:06.185640 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writer thread running {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:06.190410 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG oslo_db.sqlalchemy.engines [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109841) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:35:06.194589 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writer thread running {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:35:06.517967 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: WARNING keystonemiddleware.auth_token [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:35:06.520642 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: WARNING keystonemiddleware.auth_token [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:35:06.525299 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: WARNING keystonemiddleware.auth_token [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:35:06.528045 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: WARNING keystonemiddleware.auth_token [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:35:06.863593 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: WARNING keystonemiddleware.auth_token [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:35:06.869067 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: WARNING keystonemiddleware.auth_token [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:35:06.869304 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: WARNING keystonemiddleware.auth_token [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:35:06.874509 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5607b36d89c0 pid: 109840 (default app) Jul 21 05:35:06.874998 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: WARNING keystonemiddleware.auth_token [None req-50dd10c4-6267-4f37-a1cd-102d000c3326 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:35:06.876620 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:35:06.877803 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001716 Jul 21 05:35:06.878222 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Thu Jul 21 05:35:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:35:06.880242 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5607b36d89c0 pid: 109841 (default app) Jul 21 05:36:22.957022 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:22.958038 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 21 05:36:22.958427 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:22.970705 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writing DB stats nova_api:SELECT=3 {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:22.972256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writing DB stats nova_cell0:SELECT=3 {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:22.973287 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writing DB stats nova_cell1:SELECT=3 {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:22.974211 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:23.800970 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-a12547d6-c792-4814-a009-4880b61b032d admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:23.830368 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-a12547d6-c792-4814-a009-4880b61b032d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.864775 Jul 21 05:36:23.837449 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 05:36:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:36:26.068335 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:26.069334 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-e824f318-a94b-41ef-ba27-9199eedb111a None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 21 05:36:26.075256 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:26.554020 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-7fe3684c-cc32-4a2a-bf83-ba340cb43fc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "id": "c1", "disk": 1}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:26.572212 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:26.572212 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: warnings.warn(msg) Jul 21 05:36:26.601657 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-7fe3684c-cc32-4a2a-bf83-ba340cb43fc9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521856 Jul 21 05:36:26.602328 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:26.616583 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_api:SELECT=3 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:26.617861 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_cell1:SELECT=3 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:26.618713 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_cell0:SELECT=3 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:26.619576 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:26.824326 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-f5aaad07-f8cc-4050-813f-2985479ffa09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:26.826983 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:26.826983 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: warnings.warn(msg) Jul 21 05:36:26.891314 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-f5aaad07-f8cc-4050-813f-2985479ffa09 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.280607 Jul 21 05:36:26.892107 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 05:36:26 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:36:29.138344 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-7fe3684c-cc32-4a2a-bf83-ba340cb43fc9 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:29.139597 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-7fe3684c-cc32-4a2a-bf83-ba340cb43fc9 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Jul 21 05:36:29.140353 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:29.804590 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-c2a5a25f-a9b5-4f96-9b23-585585635f73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "swap": 0, "id": "d1"}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:29.823672 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:29.823672 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: warnings.warn(msg) Jul 21 05:36:29.843082 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-c2a5a25f-a9b5-4f96-9b23-585585635f73 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.696813 Jul 21 05:36:29.843661 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:29.857243 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-fa9632c2-02e9-4a8d-9f42-f8045ba2a712 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:29.859670 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:36:29.859670 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: warnings.warn(msg) Jul 21 05:36:29.897910 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-fa9632c2-02e9-4a8d-9f42-f8045ba2a712 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046084 Jul 21 05:36:29.900006 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 05:36:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:36:32.108302 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-c2a5a25f-a9b5-4f96-9b23-585585635f73 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:32.109606 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-c2a5a25f-a9b5-4f96-9b23-585585635f73 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 21 05:36:32.119143 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:32 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:32.515495 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-63dc8687-4656-444d-8f20-fa3b0db6fe8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "disk": 10}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:32.534160 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-63dc8687-4656-444d-8f20-fa3b0db6fe8c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418417 Jul 21 05:36:32.542162 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:32.547319 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-e90d1f0e-7025-438e-9050-bf1bccd69d44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:32.572527 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-e90d1f0e-7025-438e-9050-bf1bccd69d44 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028985 Jul 21 05:36:32.573097 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 05:36:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:36:34.827951 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-63dc8687-4656-444d-8f20-fa3b0db6fe8c admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:34.829189 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-63dc8687-4656-444d-8f20-fa3b0db6fe8c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001769 Jul 21 05:36:34.829693 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:35.250547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-516e1337-8932-4929-85f7-152d3b4eebf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds2G", "id": "d3", "disk": 10, "swap": 0, "vcpus": 2}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:35.270144 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-516e1337-8932-4929-85f7-152d3b4eebf5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434002 Jul 21 05:36:35.277791 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:35.285838 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-d267e7f7-a83e-430e-8145-d67c89f9e118 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:35.322230 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-d267e7f7-a83e-430e-8145-d67c89f9e118 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042386 Jul 21 05:36:35.323103 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 05:36:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:36:37.550501 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-516e1337-8932-4929-85f7-152d3b4eebf5 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:37.552173 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-516e1337-8932-4929-85f7-152d3b4eebf5 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002116 Jul 21 05:36:37.552764 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:37.970062 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-d37d3f90-224d-42c1-abb5-5c3407b33c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:37.987829 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-d37d3f90-224d-42c1-abb5-5c3407b33c2e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.429085 Jul 21 05:36:37.988690 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:38.000607 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-582d0df5-0f65-4c32-b0fa-35df24d6f77a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:38.023651 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-582d0df5-0f65-4c32-b0fa-35df24d6f77a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026706 Jul 21 05:36:38.024222 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 05:36:37 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:36:40.453039 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-d37d3f90-224d-42c1-abb5-5c3407b33c2e admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:40.454089 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-d37d3f90-224d-42c1-abb5-5c3407b33c2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001823 Jul 21 05:36:40.454608 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:40.915548 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-6c595659-8cde-41a2-8148-6d36e350978e admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:40.942393 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-6c595659-8cde-41a2-8148-6d36e350978e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479723 Jul 21 05:36:40.942973 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 05:36:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:36:43.326246 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-d37d3f90-224d-42c1-abb5-5c3407b33c2e admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:43.327613 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-d37d3f90-224d-42c1-abb5-5c3407b33c2e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Jul 21 05:36:43.328079 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:43.779599 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-325a0502-ae48-4d90-a85b-97444ada0126 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "disk": 1}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:43.802572 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-325a0502-ae48-4d90-a85b-97444ada0126 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.465963 Jul 21 05:36:43.804398 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:43 2022] POST /compute/v2.1/flavors => generated 402 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 05:36:43.821002 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-246ab1b9-4e04-47b0-ac98-3062390f6be1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:43.849562 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-246ab1b9-4e04-47b0-ac98-3062390f6be1 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033987 Jul 21 05:36:43.850260 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 05:36:43 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:36:46.313832 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-325a0502-ae48-4d90-a85b-97444ada0126 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:46.314841 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-325a0502-ae48-4d90-a85b-97444ada0126 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 21 05:36:46.315324 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:46.728002 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-46c01a24-f9ff-4306-af85-6d8608a03b31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:46.746860 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-46c01a24-f9ff-4306-af85-6d8608a03b31 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.425431 Jul 21 05:36:46.747454 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:46.760069 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-9eda2f5a-a5a3-4765-996a-5a022930d4a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:46.786205 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-9eda2f5a-a5a3-4765-996a-5a022930d4a3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029757 Jul 21 05:36:46.786903 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 05:36:46 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:36:49.002378 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-46c01a24-f9ff-4306-af85-6d8608a03b31 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:49.003425 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-46c01a24-f9ff-4306-af85-6d8608a03b31 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 21 05:36:49.003826 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:49.402684 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-5a1f6fe9-96f7-40dd-99ab-0b8538f4608b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "swap": 0, "ram": 4096}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:49.427726 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-5a1f6fe9-96f7-40dd-99ab-0b8538f4608b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.418007 Jul 21 05:36:49.428872 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:49.440710 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-d8cd992b-2938-4200-8e98-a7219ad771b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:49.464174 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-d8cd992b-2938-4200-8e98-a7219ad771b6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027052 Jul 21 05:36:49.464765 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 05:36:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:36:51.714892 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-5a1f6fe9-96f7-40dd-99ab-0b8538f4608b admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:51.715908 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-5a1f6fe9-96f7-40dd-99ab-0b8538f4608b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 21 05:36:51.716779 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:52.157247 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-330d53fd-6a4c-4768-877f-ba78b88b872b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "name": "m1.large", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "4", "ram": 8192}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:52.176909 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-330d53fd-6a4c-4768-877f-ba78b88b872b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.454142 Jul 21 05:36:52.177449 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:52.189334 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-3e8a04b5-33a9-48c0-90b2-9389c355a60a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:52.215321 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-3e8a04b5-33a9-48c0-90b2-9389c355a60a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029586 Jul 21 05:36:52.216495 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 05:36:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:36:54.466009 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-330d53fd-6a4c-4768-877f-ba78b88b872b admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:36:54.467097 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-330d53fd-6a4c-4768-877f-ba78b88b872b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jul 21 05:36:54.467524 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:36:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:36:54.904154 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-2d7a9139-6ea7-4d53-b407-05d54a2f81bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "id": "5"}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:54.925435 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-2d7a9139-6ea7-4d53-b407-05d54a2f81bd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450928 Jul 21 05:36:54.926258 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 05:36:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:36:54.938601 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-5d182c75-1c5b-4ff1-a069-55ed3fa9ee9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:36:54.942149 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:36:54.965057 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-5d182c75-1c5b-4ff1-a069-55ed3fa9ee9f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030164 Jul 21 05:36:54.965954 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 05:36:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:37:14.296257 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-2d7a9139-6ea7-4d53-b407-05d54a2f81bd admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:14.297357 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-2d7a9139-6ea7-4d53-b407-05d54a2f81bd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 21 05:37:14.297726 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:37:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:14.711524 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-fc68d9c4-759a-43e0-8e02-c922cbad21e1 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:14.728687 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-fc68d9c4-759a-43e0-8e02-c922cbad21e1 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.424664 Jul 21 05:37:14.729195 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 05:37:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:37:15.815537 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-2d7a9139-6ea7-4d53-b407-05d54a2f81bd admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:15.816508 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-2d7a9139-6ea7-4d53-b407-05d54a2f81bd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 21 05:37:15.816900 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:16.389143 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-f56e654d-ac9c-4786-b183-a0fe0f1ef108 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:16.395656 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.wsgi [None req-f56e654d-ac9c-4786-b183-a0fe0f1ef108 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-f56e654d-ac9c-4786-b183-a0fe0f1ef108 admin admin] Request method failure captured: Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Accept: application/json Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Accept-Encoding: gzip, deflate Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Connection: keep-alive Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Content-Length: 0 Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Host: 10.222.0.44 Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Openstack-Api-Version: compute 2.90 Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Openstack-System-Scope: None Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: User-Agent: python-novaclient Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Auth-Token: gAAAAABi2OYLI5_oPVl5O04wmu5NWm6-J_2wmKJWk3qfOskKKBhU0W6cQZpo2lQVPwhiAHcAxc0cu_uKNtJGMRcPGkZIr9HDEBZyeUs2ZolL9p4Hww8o_nneScxilTLLsIVxlrPWnDOI6Hif1AfroFxftL_IZBBbQwb1Y9-lvGnACj_sW3Cbs8Y Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Domain-Id: None Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Domain-Name: None Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Identity-Status: Confirmed Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Is-Admin-Project: True Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Domain-Id: default Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Domain-Name: Default Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Name: admin Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Role: admin,member,reader Jul 21 05:37:16.398942 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Roles: admin,member,reader Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f7ec186b03924ec6a68eab5b0ea7d82d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}] Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant: admin Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant-Name: admin Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User: admin Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Domain-Id: default Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Domain-Name: Default Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Id: 3b3cc4a53587419894e0f708d1e60e89 Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Name: admin Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: method: > Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: exception: Flavor 42 could not be found. Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: action_args: {'id': '42'} Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:37:16.400551 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:16.401491 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.402602 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-f56e654d-ac9c-4786-b183-a0fe0f1ef108 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:37:16.403710 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-f56e654d-ac9c-4786-b183-a0fe0f1ef108 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.440006 Jul 21 05:37:16.403710 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 05:37:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 441 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 05:37:16.410798 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-a18c060e-f12f-40c8-9f94-2b309ef6519f admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:16.413823 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:37:16.433274 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-a18c060e-f12f-40c8-9f94-2b309ef6519f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026448 Jul 21 05:37:16.433813 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 05:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:37:16.446319 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-581b12b5-c829-4bc8-aa3c-fbbb2a3e8923 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:16.469834 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-581b12b5-c829-4bc8-aa3c-fbbb2a3e8923 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029355 Jul 21 05:37:16.470335 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 05:37:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:37:16.479829 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-15f4a5d5-3aec-4ea6-b374-3df9d565f3e4 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:16.486249 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.wsgi [None req-15f4a5d5-3aec-4ea6-b374-3df9d565f3e4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-15f4a5d5-3aec-4ea6-b374-3df9d565f3e4 admin admin] Request method failure captured: Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Accept: application/json Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Accept-Encoding: gzip, deflate Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Connection: keep-alive Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Content-Length: 0 Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Host: 10.222.0.44 Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Openstack-Api-Version: compute 2.90 Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Openstack-System-Scope: None Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: User-Agent: python-novaclient Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Auth-Token: gAAAAABi2OYLI5_oPVl5O04wmu5NWm6-J_2wmKJWk3qfOskKKBhU0W6cQZpo2lQVPwhiAHcAxc0cu_uKNtJGMRcPGkZIr9HDEBZyeUs2ZolL9p4Hww8o_nneScxilTLLsIVxlrPWnDOI6Hif1AfroFxftL_IZBBbQwb1Y9-lvGnACj_sW3Cbs8Y Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Domain-Id: None Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Domain-Name: None Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Identity-Status: Confirmed Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Is-Admin-Project: True Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Domain-Id: default Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Domain-Name: Default Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Name: admin Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Role: admin,member,reader Jul 21 05:37:16.489547 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Roles: admin,member,reader Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f7ec186b03924ec6a68eab5b0ea7d82d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}] Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant: admin Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant-Name: admin Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User: admin Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Domain-Id: default Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Domain-Name: Default Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Id: 3b3cc4a53587419894e0f708d1e60e89 Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Name: admin Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: method: > Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: exception: Flavor 42 could not be found. Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: action_args: {'id': '42'} Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:37:16.491033 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:16.492036 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:16.493248 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-15f4a5d5-3aec-4ea6-b374-3df9d565f3e4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:37:16.494258 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-15f4a5d5-3aec-4ea6-b374-3df9d565f3e4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014682 Jul 21 05:37:16.494258 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 05:37:16 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 05:37:17.477155 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-581b12b5-c829-4bc8-aa3c-fbbb2a3e8923 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:17.478159 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-581b12b5-c829-4bc8-aa3c-fbbb2a3e8923 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 21 05:37:17.478548 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:18.047630 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-f0948c99-25ae-44b6-8096-b09e27b1559d admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:18.053141 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.wsgi [None req-f0948c99-25ae-44b6-8096-b09e27b1559d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-f0948c99-25ae-44b6-8096-b09e27b1559d admin admin] Request method failure captured: Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Accept: application/json Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Accept-Encoding: gzip, deflate Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Connection: keep-alive Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Content-Length: 0 Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Host: 10.222.0.44 Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Openstack-Api-Version: compute 2.90 Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Openstack-System-Scope: None Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: User-Agent: python-novaclient Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Auth-Token: gAAAAABi2OYNEpE_rn6Ub2MQNaeNhDvrm9XC0WKJIYjzHMSj5SpCX-tcQsOyfDxH47TPP_i8pIzmVNTKGz73xHO6XDJmmQPyh5iY5ev9IJtFaObesRHu0p43sxARctHGhXCL5AUpKD6kEOm8HxPorGL7zo3wXNi2bsTquDGYH3gScDnKFhQr200 Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Domain-Id: None Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Domain-Name: None Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Identity-Status: Confirmed Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Is-Admin-Project: True Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Domain-Id: default Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Domain-Name: Default Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Name: admin Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Role: admin,member,reader Jul 21 05:37:18.054647 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Roles: admin,member,reader Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f7ec186b03924ec6a68eab5b0ea7d82d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}] Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant: admin Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant-Name: admin Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User: admin Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Domain-Id: default Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Domain-Name: Default Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Id: 3b3cc4a53587419894e0f708d1e60e89 Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Name: admin Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: method: > Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: exception: Flavor 84 could not be found. Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: action_args: {'id': '84'} Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:37:18.056059 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:18.056919 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.058292 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-f0948c99-25ae-44b6-8096-b09e27b1559d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:37:18.059658 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-f0948c99-25ae-44b6-8096-b09e27b1559d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.442453 Jul 21 05:37:18.059658 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 05:37:17 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 05:37:18.066232 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-1e6e3080-f3e0-487f-8be4-685d0b91af3b admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:18.079953 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-1e6e3080-f3e0-487f-8be4-685d0b91af3b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017569 Jul 21 05:37:18.080468 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 05:37:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:37:18.089857 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-56af8d43-0a4a-4edd-b839-0a98b2008882 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:18.103985 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-56af8d43-0a4a-4edd-b839-0a98b2008882 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017669 Jul 21 05:37:18.104503 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 05:37:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:37:18.113554 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-07b6562f-7eee-4db2-9e51-e7af79808ffc admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:18.119132 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.wsgi [None req-07b6562f-7eee-4db2-9e51-e7af79808ffc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-07b6562f-7eee-4db2-9e51-e7af79808ffc admin admin] Request method failure captured: Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Accept: application/json Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Accept-Encoding: gzip, deflate Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Connection: keep-alive Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Content-Length: 0 Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Host: 10.222.0.44 Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Openstack-Api-Version: compute 2.90 Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Openstack-System-Scope: None Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: User-Agent: python-novaclient Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Auth-Token: gAAAAABi2OYNEpE_rn6Ub2MQNaeNhDvrm9XC0WKJIYjzHMSj5SpCX-tcQsOyfDxH47TPP_i8pIzmVNTKGz73xHO6XDJmmQPyh5iY5ev9IJtFaObesRHu0p43sxARctHGhXCL5AUpKD6kEOm8HxPorGL7zo3wXNi2bsTquDGYH3gScDnKFhQr200 Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Domain-Id: None Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Domain-Name: None Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Identity-Status: Confirmed Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Is-Admin-Project: True Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Domain-Id: default Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Domain-Name: Default Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Name: admin Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Role: admin,member,reader Jul 21 05:37:18.120620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Roles: admin,member,reader Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f7ec186b03924ec6a68eab5b0ea7d82d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}] Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant: admin Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant-Name: admin Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User: admin Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Domain-Id: default Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Domain-Name: Default Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Id: 3b3cc4a53587419894e0f708d1e60e89 Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Name: admin Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: method: > Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: exception: Flavor 84 could not be found. Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: action_args: {'id': '84'} Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:37:18.122167 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:18.123187 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:18.124256 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-07b6562f-7eee-4db2-9e51-e7af79808ffc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:37:18.125362 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-07b6562f-7eee-4db2-9e51-e7af79808ffc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011810 Jul 21 05:37:18.125362 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 05:37:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 05:37:19.104827 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-56af8d43-0a4a-4edd-b839-0a98b2008882 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:19.105828 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-56af8d43-0a4a-4edd-b839-0a98b2008882 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 21 05:37:19.106243 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:19.655843 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-7ea1ce00-f8e1-42d7-879a-906ab43ba729 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:19.662577 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.wsgi [None req-7ea1ce00-f8e1-42d7-879a-906ab43ba729 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-7ea1ce00-f8e1-42d7-879a-906ab43ba729 admin admin] Request method failure captured: Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Accept: application/json Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Accept-Encoding: gzip, deflate Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Connection: keep-alive Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Content-Length: 0 Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Host: 10.222.0.44 Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Openstack-Api-Version: compute 2.90 Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Openstack-System-Scope: None Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: User-Agent: python-novaclient Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Auth-Token: gAAAAABi2OYO-Cnh-biA9FsC5xR8HTb28FjIHEe7ANNFNHYBVzRofnp7Rl-cL6cDMi7VOiYph3VffjddzvIS-ux2uit76C-5Fl5CZ1K332-TwZllQNvK1maAdoQWiXei7RSzIlAzBJWIOUeJshi65ullrKwnTsgKY8yfwGQ8_oeQkHlPpguJFHM Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Domain-Id: None Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Domain-Name: None Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Identity-Status: Confirmed Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Is-Admin-Project: True Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Domain-Id: default Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Domain-Name: Default Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Project-Name: admin Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Role: admin,member,reader Jul 21 05:37:19.664397 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Roles: admin,member,reader Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f7ec186b03924ec6a68eab5b0ea7d82d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}] Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant: admin Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-Tenant-Name: admin Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User: admin Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Domain-Id: default Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Domain-Name: Default Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Id: 3b3cc4a53587419894e0f708d1e60e89 Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: X-User-Name: admin Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: method: > Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: exception: Flavor 451 could not be found. Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: action_args: {'id': '451'} Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:37:19.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:19.667075 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.668641 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-7ea1ce00-f8e1-42d7-879a-906ab43ba729 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109841) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:37:19.669899 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-7ea1ce00-f8e1-42d7-879a-906ab43ba729 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416024 Jul 21 05:37:19.669899 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 05:37:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 05:37:19.678350 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-723fc847-d492-48e0-b97d-b61c19632ab6 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:19.694929 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-723fc847-d492-48e0-b97d-b61c19632ab6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022455 Jul 21 05:37:19.695522 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 05:37:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:37:19.705073 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:19.720254 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018744 Jul 21 05:37:19.720779 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 05:37:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:37:19.730156 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-9670bc77-17c1-4300-b2a2-506c7a6c86f9 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:19.735533 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.wsgi [None req-9670bc77-17c1-4300-b2a2-506c7a6c86f9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-9670bc77-17c1-4300-b2a2-506c7a6c86f9 admin admin] Request method failure captured: Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Accept: application/json Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Accept-Encoding: gzip, deflate Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Connection: keep-alive Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Content-Length: 0 Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Host: 10.222.0.44 Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Openstack-Api-Version: compute 2.90 Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Openstack-System-Scope: None Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: User-Agent: python-novaclient Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Auth-Token: gAAAAABi2OYO-Cnh-biA9FsC5xR8HTb28FjIHEe7ANNFNHYBVzRofnp7Rl-cL6cDMi7VOiYph3VffjddzvIS-ux2uit76C-5Fl5CZ1K332-TwZllQNvK1maAdoQWiXei7RSzIlAzBJWIOUeJshi65ullrKwnTsgKY8yfwGQ8_oeQkHlPpguJFHM Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Domain-Id: None Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Domain-Name: None Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Identity-Status: Confirmed Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Is-Admin-Project: True Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Domain-Id: default Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Domain-Name: Default Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Project-Name: admin Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Role: admin,member,reader Jul 21 05:37:19.737020 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Roles: admin,member,reader Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f7ec186b03924ec6a68eab5b0ea7d82d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f7ec186b03924ec6a68eab5b0ea7d82d"}]}] Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant: admin Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant-Id: f7ec186b03924ec6a68eab5b0ea7d82d Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-Tenant-Name: admin Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User: admin Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Domain-Id: default Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Domain-Name: Default Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Id: 3b3cc4a53587419894e0f708d1e60e89 Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: X-User-Name: admin Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: method: > Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: exception: Flavor 451 could not be found. Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: action_args: {'id': '451'} Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:37:19.738535 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:19.739586 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: ERROR nova.api.openstack.wsgi Jul 21 05:37:19.740675 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-9670bc77-17c1-4300-b2a2-506c7a6c86f9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109840) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:37:19.741696 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-9670bc77-17c1-4300-b2a2-506c7a6c86f9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011786 Jul 21 05:37:19.741696 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 05:37:19 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 05:37:20.715647 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:20.716747 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 21 05:37:20.717118 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:21.311380 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-374a2963-b8cf-469e-be9d-0fac945346db admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:37:21.332286 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-374a2963-b8cf-469e-be9d-0fac945346db admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.475111 Jul 21 05:37:21.332899 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 05:37:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:37:22.293226 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:22.294212 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 21 05:37:22.294599 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:22.842414 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-19bb7043-12d1-4a55-bd06-a57c3aaeadbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:37:22.865295 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-19bb7043-12d1-4a55-bd06-a57c3aaeadbf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.436208 Jul 21 05:37:22.865841 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 05:37:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:37:23.862016 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:23.863046 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jul 21 05:37:23.863473 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:24.426455 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-19d62765-1a5d-4b65-85f9-537c212be719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:37:24.446571 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-19d62765-1a5d-4b65-85f9-537c212be719 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.444531 Jul 21 05:37:24.447122 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 05:37:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:37:25.440105 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:25.441030 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 21 05:37:25.441427 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:26.037556 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-2f992a5e-1735-418b-adab-da0883f77383 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:37:26.062548 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-2f992a5e-1735-418b-adab-da0883f77383 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.469761 Jul 21 05:37:26.063161 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 05:37:25 2022] POST /compute/v2.1/flavors => generated 409 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:37:27.187872 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:27.188980 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 21 05:37:27.189371 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:37:27.738081 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-c4e32748-fa5c-42e5-9243-e5fd666c12ab admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:37:27.756942 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-c4e32748-fa5c-42e5-9243-e5fd666c12ab admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.432769 Jul 21 05:37:27.757465 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Thu Jul 21 05:37:27 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:38:19.737313 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:38:19.738323 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-e2c03c99-5e1a-4a4c-be9a-4760656ca9f6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 21 05:38:19.738715 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 05:38:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:38:19.749447 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:38:20.152661 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-d8f8d54c-4547-490d-b268-56215d28a6da admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:38:20.172906 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-d8f8d54c-4547-490d-b268-56215d28a6da admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.427998 Jul 21 05:38:20.173378 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 05:38:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:38:20.200261 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG dbcounter [-] [109841] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=109841) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:38:20.203995 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-6ddd9084-20b9-4192-bb86-919b8c591630 admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:38:20.212079 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-6ddd9084-20b9-4192-bb86-919b8c591630 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013306 Jul 21 05:38:20.212566 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jul 21 05:38:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:38:20.224328 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-bf72883b-2045-4962-a729-368d1e34ac4e admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:38:20.232148 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-bf72883b-2045-4962-a729-368d1e34ac4e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011563 Jul 21 05:38:20.232676 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jul 21 05:38:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:38:20.244882 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:38:20.253058 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012020 Jul 21 05:38:20.253571 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jul 21 05:38:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:38:20.265334 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-d144d133-817a-439c-bcf5-d0316cadf45f admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:38:20.273011 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-d144d133-817a-439c-bcf5-d0316cadf45f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011472 Jul 21 05:38:20.273519 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jul 21 05:38:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:41:39.281383 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:39.282381 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 21 05:41:39.282735 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:41:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:41:39.426931 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_api:SELECT=6 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:39.602610 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-7804c364-118a-4a37-8b4f-4a9c0c74ead0 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:39.603954 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:41:39.603954 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: warnings.warn(msg) Jul 21 05:41:39.605165 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-7804c364-118a-4a37-8b4f-4a9c0c74ead0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:39.605579 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-7804c364-118a-4a37-8b4f-4a9c0c74ead0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:39.606350 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-7804c364-118a-4a37-8b4f-4a9c0c74ead0 admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:39.606763 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-7804c364-118a-4a37-8b4f-4a9c0c74ead0 admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:39.640689 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-7804c364-118a-4a37-8b4f-4a9c0c74ead0 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.216182 Jul 21 05:41:39.641256 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 05:41:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:41:40.471481 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:40.472483 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 21 05:41:40.472863 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:41:40.667514 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-14a69584-06f5-4611-a4aa-74efaefcd5fc admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:40.668682 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:41:40.668682 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: warnings.warn(msg) Jul 21 05:41:40.669879 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-14a69584-06f5-4611-a4aa-74efaefcd5fc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:40.670317 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-14a69584-06f5-4611-a4aa-74efaefcd5fc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:40.671101 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-14a69584-06f5-4611-a4aa-74efaefcd5fc admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:40.671560 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-14a69584-06f5-4611-a4aa-74efaefcd5fc admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:40.690905 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-14a69584-06f5-4611-a4aa-74efaefcd5fc admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081993 Jul 21 05:41:40.691498 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 05:41:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:41:51.962522 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:51.963620 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jul 21 05:41:51.963996 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:41:52.105056 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_cell0:SELECT=4 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:52.105739 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_cell1:SELECT=4 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:52.106340 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG dbcounter [-] [109840] Writing DB stats nova_api:SELECT=8 {{(pid=109840) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:41:52.164588 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-312c6bee-762b-4a71-8f51-91520920c43f admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:52.165792 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:41:52.165792 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: warnings.warn(msg) Jul 21 05:41:52.167052 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-312c6bee-762b-4a71-8f51-91520920c43f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:52.167526 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-312c6bee-762b-4a71-8f51-91520920c43f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:52.168305 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-312c6bee-762b-4a71-8f51-91520920c43f admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:52.168728 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-312c6bee-762b-4a71-8f51-91520920c43f admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:52.193698 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-312c6bee-762b-4a71-8f51-91520920c43f admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093088 Jul 21 05:41:52.194176 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 05:41:52 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:41:53.037539 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: DEBUG nova.api.openstack.wsgi [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] Calling method '>' {{(pid=109841) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:53.038537 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: INFO nova.api.openstack.requestlog [None req-8579e1df-088b-4dce-a600-6e922d5a313c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 21 05:41:53.038926 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: [pid: 109841|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 05:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:41:53.231619 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG nova.api.openstack.wsgi [None req-8e2edff6-2e9f-4019-a6f1-a71ba704d3d2 admin admin] Calling method '>' {{(pid=109840) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:41:53.232786 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 05:41:53.232786 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: warnings.warn(msg) Jul 21 05:41:53.233959 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-8e2edff6-2e9f-4019-a6f1-a71ba704d3d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:53.234388 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-8e2edff6-2e9f-4019-a6f1-a71ba704d3d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:53.235308 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-8e2edff6-2e9f-4019-a6f1-a71ba704d3d2 admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:41:53.235727 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: DEBUG oslo_concurrency.lockutils [None req-8e2edff6-2e9f-4019-a6f1-a71ba704d3d2 admin admin] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109840) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:41:53.257146 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: INFO nova.api.openstack.requestlog [None req-8e2edff6-2e9f-4019-a6f1-a71ba704d3d2 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082011 Jul 21 05:41:53.257617 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: [pid: 109840|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 05:41:53 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:42:49.565200 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: Thu Jul 21 05:42:49 2022 - graceful shutdown triggered... Jul 21 05:42:49.565706 dv-cinder-850449-1-iscsi devstack@n-api.service[109840]: Gracefully killing worker 1 (pid: 109840)... Jul 21 05:42:49.565311 dv-cinder-850449-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 05:42:49.566552 dv-cinder-850449-1-iscsi devstack@n-api.service[109841]: Gracefully killing worker 2 (pid: 109841)... Jul 21 05:42:50.565879 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: worker 1 buried after 1 seconds Jul 21 05:42:50.565879 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: worker 2 buried after 1 seconds Jul 21 05:42:50.565879 dv-cinder-850449-1-iscsi devstack@n-api.service[109839]: goodbye to uWSGI. Jul 21 05:42:50.568423 dv-cinder-850449-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 05:42:50.569323 dv-cinder-850449-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 05:42:50.573940 dv-cinder-850449-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 05:42:50.587129 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 05:42:50 2022] *** Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: nodename: dv-cinder-850449-1-iscsi Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: machine: x86_64 Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: clock source: unix Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: pcre jit disabled Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: detected number of CPU cores: 4 Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: current working directory: / Jul 21 05:42:50.589443 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: detected binary path: /usr/bin/uwsgi-core Jul 21 05:42:50.590161 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: your processes number limit is 47680 Jul 21 05:42:50.590161 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: your memory page size is 4096 bytes Jul 21 05:42:50.590161 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: detected max file descriptor number: 2048 Jul 21 05:42:50.590161 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: lock engine: pthread robust mutexes Jul 21 05:42:50.590161 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: thunder lock: enabled Jul 21 05:42:50.590161 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 05:42:50.590161 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 05:42:50.633482 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: Python main interpreter initialized at 0x55598be209c0 Jul 21 05:42:50.633482 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: python threads support enabled Jul 21 05:42:50.633482 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: your server socket listen backlog is limited to 100 connections Jul 21 05:42:50.633482 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: your mercy for graceful operations on workers is 90 seconds Jul 21 05:42:50.633922 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 05:42:50.633922 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: *** Operational MODE: preforking *** Jul 21 05:42:50.634235 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: *** uWSGI is running in multiple interpreter mode *** Jul 21 05:42:50.634235 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: spawned uWSGI master process (pid: 124309) Jul 21 05:42:50.634469 dv-cinder-850449-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 05:42:50.639047 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: spawned uWSGI worker 1 (pid: 124328, cores: 1) Jul 21 05:42:50.639047 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: spawned uWSGI worker 2 (pid: 124329, cores: 1) Jul 21 05:42:50.639047 dv-cinder-850449-1-iscsi devstack@n-api.service[124309]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 05:42:51.283521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 05:42:51.291723 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 05:42:52.457376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:42:52.457376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: from cryptography.utils import int_from_bytes Jul 21 05:42:52.458106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:42:52.458106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: from cryptography.utils import int_from_bytes Jul 21 05:42:52.493104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:42:52.493104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: from cryptography.utils import int_from_bytes Jul 21 05:42:52.493646 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 05:42:52.493646 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: from cryptography.utils import int_from_bytes Jul 21 05:42:54.741441 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 05:42:54.742908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 05:42:54.743699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 05:42:54.744294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 05:42:54.744763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 05:42:54.745354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.745681 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.745982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.746307 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.746675 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.747050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.747460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.747785 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.748117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.748544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.749012 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.749507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850449-1-iscsi {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.749833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.750135 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.750440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.750756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.751201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.751419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.751723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.752299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.753036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.753345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.753656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.754076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.754663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.755302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.755701 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.756267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.757064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.758708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.759362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850449-1-iscsi {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.759695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.760205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.760681 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.761117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.761442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.761754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.762232 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.762714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.763320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.763802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.764360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.765130 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.765671 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.766038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.766425 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.766755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.767105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.767414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.767963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.768607 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.769480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.770179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.770806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.771444 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.771879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.772197 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.772591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.772982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.773363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.773741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.774123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.774498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.774946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.775538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.775921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.776241 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.776564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.776884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.777213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.777526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.777895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.778260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.778572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.778906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.779277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.779595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.779905 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.780227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.780547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.780852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.781165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.781475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.781792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.782136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.782440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.782691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.782993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.783322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.783641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.783949 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.784258 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.784567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.784866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.785171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.785851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.786161 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.786470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.786775 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.787104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.787412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.787716 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.788018 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.788347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.788728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.789038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.789986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.790297 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.790644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.790973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.791306 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.791617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.791938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.792246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.792550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.792867 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.793174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.793478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.793790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.794277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.794586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.794901 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.795244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.795550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.795851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.796338 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.796646 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.796953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.797259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.797566 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.797865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.798187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.798510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.798816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.799156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.799464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.799780 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.800118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.800448 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.800789 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.801099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.801429 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.801768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.802336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.802514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.802668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.802998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.803448 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.803757 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.804068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.804385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.804701 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.805027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.805341 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.805653 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.805976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.806280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.806594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.806918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.807267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.807582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.807917 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.808263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.808578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.808898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.809218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.809529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.809911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.810231 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.810555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.810892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.811254 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.811571 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.811883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.812193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.812500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.812808 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.813117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.813450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.813757 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.814068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.814377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.814689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.815482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.815482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.815764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.815905 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.816192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.816484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.816787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.817087 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.817914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.817914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.818242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.818395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.818600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.818905 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.819249 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.819591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.819851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.820159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.820465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.820762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.821081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.821386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.821686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.822004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.822302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.822600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.822906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.823235 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.823555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.823860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.824192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.824482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.824790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.825096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.825455 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.825782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.826101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.826406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.826725 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.827055 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.827359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.827664 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.827970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.828270 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.828568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.829024 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.829209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.829465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.829764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.830059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.830355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.830673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.830976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.831298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.831597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.831895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.832259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.832538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.832876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.833208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.833525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.833844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.834154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.834468 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.834777 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.835123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.835419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.835729 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.836046 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.836360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.836669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.836977 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.837297 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.837604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.837752 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 05:42:54.838331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.838495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 05:42:54.838647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.838802 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 05:42:54.839062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.839062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.839437 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 05:42:54.839592 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.839759 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 05:42:54.839982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.840138 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.840293 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.840445 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.840596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.840747 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.840898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.841583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.841752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.841898 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.842042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.842193 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.842336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.842500 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.842644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.842931 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.843164 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.843337 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.843483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.843637 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.843806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.844055 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.844206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.844349 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850449-1-iscsi {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.844501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.844669 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.844822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.844972 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.845123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.845265 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.845407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.845565 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.845716 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.845867 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.846010 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.846152 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.846304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.846464 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.846774 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.846774 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.847189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.847375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.847537 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.847690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.847834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.847977 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.848127 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.848386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.848547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.848712 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.848866 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.849021 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.849273 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.849497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.849655 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.849814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.849976 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.850190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.850340 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.850510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.850877 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.851048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.851208 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850449-1-iscsi {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.851353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.851353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.851651 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.851796 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.851979 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.852131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.852275 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.852418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.852570 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.852726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.852879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.853023 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.853177 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.853327 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.853558 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.853705 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.853848 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.854003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.854003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.854400 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.854547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.854698 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.854848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.855085 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.855257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.855411 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.855555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.855698 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.855845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.855995 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.856138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.856294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.856445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.856612 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.856918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.857069 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.857306 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.857483 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.857630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.857781 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.857933 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.858076 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.858236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.858387 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.858615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.858773 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.858932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.859108 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.859292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.859518 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.859518 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.859887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.860037 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.860219 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.860438 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.860587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.860730 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.860876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.861026 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.861178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.861322 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.861483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.861627 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.861776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.861927 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.862097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.862363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.862534 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.862534 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.862808 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.862968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.863148 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.863302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.863453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.863618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.863770 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.863770 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.864059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.864210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.864487 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.864648 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.864792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.864944 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.865097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.865251 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.865401 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.865544 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.865703 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.865856 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.866008 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.866160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.866304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.866453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.866606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.866768 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.867139 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.867323 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.867550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.867700 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.867862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.868137 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.868299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.868452 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.868629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.868850 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.869006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.869150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.869295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.869445 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.869683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.869914 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.869914 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.870227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.870373 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.870604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.870763 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.870915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.870915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.871314 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.871314 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.871613 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.871756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.871907 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.872058 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.872234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.872419 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.872629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.872775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.872925 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.873075 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.873218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.873361 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.873512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.873656 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.873798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.873798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.874069 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.874210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.874371 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.874618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.874775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.874931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.875127 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.875288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.875434 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.875585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.875728 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.875871 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.876014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.876166 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.876328 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.876480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.876636 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.876780 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.876923 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.877218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.877369 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.877532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.877757 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.877907 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.878050 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.878193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.878343 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.878498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.878655 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.878800 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.879054 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.879217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.879361 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.879517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.880431 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.880720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.880896 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.881144 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.881322 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.881484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.881675 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.881825 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.881968 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.882110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.882260 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.882418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.882568 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.882753 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.882911 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.883094 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.883253 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.883482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.883628 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.883829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.883987 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.884139 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.884292 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.884444 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.884611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.884851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.885002 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.885145 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.885302 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.885445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.885587 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.885728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.885881 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.886025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.886025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.886317 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.886461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.886617 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.886762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.886903 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.887076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.887415 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.887573 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.887742 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 05:42:54.888017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.888179 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.888324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.888474 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.888626 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.888777 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.889054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.889294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.889453 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.889598 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.889767 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.890010 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.890232 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.890406 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.890551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.890712 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.890934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.891117 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.891281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.891425 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.891567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.891709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.891852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.891994 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.892146 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.892290 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.892461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.892605 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.892755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.892755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.893045 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.893188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.893331 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.893483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.893633 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.893782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.893934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.894077 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.894237 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.894380 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.894530 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.894682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.894843 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.895105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.895267 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.895412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.895556 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.895713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.895865 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.898719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.898893 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.899195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.899448 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.899622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.899772 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.899927 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.900159 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.900393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.900552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.900723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.900879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.901118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.901276 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.901428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.901584 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.901739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.901890 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.902040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.902040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.902327 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.902485 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.902629 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.902771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.902922 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.903082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.903242 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.903396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.903621 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.903771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.903915 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.904075 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.904321 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.904485 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.904637 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.904779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.904923 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.905269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.905518 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.905677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.905834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.905978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.906129 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.906282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.906440 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.906591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.906741 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.906894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.907117 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.907267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.907423 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.907574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.907718 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.907871 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.908013 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.908013 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.908303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.908679 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.908835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.908979 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.909122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.909273 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.909443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.909656 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.909811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.909969 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.910168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.910168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.910969 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.911159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.911375 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.911524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.911668 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.911827 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.911972 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.912122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.912281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.912426 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.912577 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.912781 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.912934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.913085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.913229 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.913379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.913533 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.913683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.913827 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.913976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.914127 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.914276 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.914430 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.914584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.914735 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.914885 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.915067 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.915252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.915410 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.915581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.915822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.915971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.916113 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.916262 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.916420 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.916564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.916724 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.916868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.917025 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.917178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.917322 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.917466 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.917608 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.917758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.917908 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.918060 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.918204 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.918346 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.918497 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.918886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.919063 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.919267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.919461 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.919613 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.919854 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.920011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.920164 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.920394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.920547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.920699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.921007 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.921156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.921326 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.921574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.921731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.921882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922026 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922322 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922322 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922741 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922885 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.922885 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.923241 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.923394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.923546 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.923689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.923834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.923990 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.924144 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.924287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.924438 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.924589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.924739 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.924898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.925056 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.925218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.925367 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.925525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.925675 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.925857 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.926100 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.926272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.926425 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.926601 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.926876 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.927077 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.927244 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.927402 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.927564 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.927721 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.927879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.928109 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.928262 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.928420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.928571 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.928745 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.929082 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.929241 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.929398 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.929398 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.929684 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.929684 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.930095 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.930252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.930439 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.930603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.930761 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.930937 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.931295 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.931450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.931686 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.931851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.932009 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.932172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.932332 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.932497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.932656 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.932806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.932956 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.933114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.933114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.933415 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.933564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.933720 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.933878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.934042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.934203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.934356 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.934513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.934671 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.934876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.935213 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.935374 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.935533 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.935691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.935842 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.935998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.936260 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.936419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.936580 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.936738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.936914 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.937131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.937297 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.937457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.937608 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.937757 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.937906 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.938066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.938216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.938372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.938523 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.938690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.938849 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.939195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.939368 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.939521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.939679 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.939836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.939997 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.940242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.940408 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.940567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.940719 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.940886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.941045 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.941354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.941514 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.941683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.941902 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.942067 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.942227 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.942385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.942535 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.942686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.942835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.942984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.943185 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.943428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.943588 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.943747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.943897 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.944053 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.944214 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.944364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.944513 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.944662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.944812 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.944962 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.945125 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.945288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.945438 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.945587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.945587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.945893 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.946045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.946203 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.946454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.946611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.946761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.946921 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.947334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.947495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.947670 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.947830 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.947982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.948146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.948305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.948457 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.948457 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.948743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.948892 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.949053 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.949357 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.949527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.949686 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.949865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.950029 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.950189 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.950460 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.950625 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.950785 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.950936 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.951130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.951304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.951639 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.951800 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.952037 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.952207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.952372 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.952523 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.952673 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.952824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.952982 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.953141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.953310 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.953470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.953627 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.953784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.953949 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954276 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.954868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.955381 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.955539 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.955689 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.955838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.956002 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.956152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.956313 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.956480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.956717 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.956882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.957044 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.957196 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.957430 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.957595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.957757 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.957923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.958077 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.958226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.958388 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.958538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.958538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.958832 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.958984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.959155 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.959471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.959471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.959900 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.960130 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.960293 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.960472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.960703 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.960859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.961029 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.961189 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.961347 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.961617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.961775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.961934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.962288 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.962495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.962667 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.962834 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.963005 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.963192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.963346 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.963495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.963646 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.963807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.963965 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.964115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.964265 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.964414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.964570 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.964735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.964892 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.965054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.965205 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.965362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.965522 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.965687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.965840 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.966044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.966214 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.966374 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.966535 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.966820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.966981 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.967198 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.967363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.967605 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.967773 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.967773 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.968088 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.968339 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.968510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.968670 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.968835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.968987 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.969145 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.969296 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.969600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.969801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.970024 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.970186 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.970346 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.970503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.970654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.970905 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.971080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.971250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.971417 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.971593 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.971832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.972011 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.972182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.972409 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.972572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.972739 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.972891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.973042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.973201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.973354 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.973512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.973676 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.973838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.973989 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.974156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.974392 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.974557 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.974718 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.974870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.975074 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.975234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.975384 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.975384 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.975684 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.975834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.975991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.976158 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.976507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.976675 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.976853 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.977089 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.977255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.977415 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.977583 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.977816 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.977975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.978141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.978302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.978453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.978614 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.978778 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.978929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.979111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.979274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.979470 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.979771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.979771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.980146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.980303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.980463 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.980614 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.980777 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.981032 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.981296 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.981296 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.981674 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.981848 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.982078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.982078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.982404 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.982622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.982785 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.982785 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.983230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.983396 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.983596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.983596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.983897 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.984047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.984212 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.984364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.984522 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.984683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.984833 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.984998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.985149 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.985299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.985456 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.985618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.985778 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.985938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.986089 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.986247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.986405 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.986564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.986715 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.986874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.987055 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.987055 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.987457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.987621 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.987790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.988020 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.988177 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.988329 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.989068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.989227 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.989386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.989546 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.989856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.990028 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.990285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.990451 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.990603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.990754 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.990919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.991188 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.991349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.991549 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.991711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.991863 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.991863 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.992256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.992420 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.992601 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.992827 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.992984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.993145 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.993296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.993296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.993581 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.993731 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.993881 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.994042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.994194 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.994350 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.994548 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.994722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.994884 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.995066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.995235 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.995388 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.995537 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.995686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.995851 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.996003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.996155 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.996304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.996453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.996618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.996790 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.996941 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.997091 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.997290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.997548 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.997722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.997887 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.998127 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.998286 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.998447 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.998606 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.998771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.998934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.999112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.999269 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.999419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.999569 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:54.999738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.000075 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.000251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.000495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.000659 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.000818 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.000978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.001130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.001389 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.001554 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.001722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.001875 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002140 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002349 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002529 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002708 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.002947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003099 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003439 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003590 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003811 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.003961 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004106 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004262 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004343 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004417 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004708 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004708 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.004953 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005184 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005353 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005426 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005506 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005592 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005665 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005745 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.005819 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006220 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006307 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006405 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006667 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.006939 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007362 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007550 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007744 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.007927 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008018 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008277 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008477 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008571 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008656 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.008926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009012 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009346 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009524 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009700 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009885 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.009990 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010087 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010261 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010706 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.010975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011229 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011658 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011837 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.011929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012194 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012346 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012528 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012625 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012717 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012801 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.012994 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013077 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013328 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013671 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013848 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.013939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014031 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014199 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014381 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014556 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014733 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014902 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.014986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015249 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015402 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015485 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015568 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.015979 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016065 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016149 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016245 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016330 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016504 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016672 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016856 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.016948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017040 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017398 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017564 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017564 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017821 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017907 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.017991 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018165 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018466 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018537 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018607 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018690 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018881 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.018966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019266 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019548 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019733 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.019916 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.020632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.021756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.022934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.023577 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.023577 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.023792 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.024106 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.024419 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.024731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.025068 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.025391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.025715 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.026126 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.026451 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.026783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.027947 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.028284 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.028699 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.029023 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.030466 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.030877 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.031265 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.032771 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.033143 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.033457 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.033793 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.034129 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.034460 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.034783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.035133 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.035823 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.036173 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.036523 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.036854 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.037174 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.037493 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.037814 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.038412 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.038729 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.039141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.039538 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.039893 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.040238 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.040580 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.040951 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.041275 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.041668 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.041969 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.042288 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.042600 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.043672 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.043672 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.043873 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.044223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.044546 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.045158 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.045515 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.045886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.046167 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.046497 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.046821 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.047158 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.047489 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.047797 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.048113 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.048422 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.048736 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.049042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.049347 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.049663 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.049974 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.050275 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.050683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.050891 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.051256 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.051566 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.051874 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.052178 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.052489 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.052797 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.053103 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.053408 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.053739 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.054050 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.054353 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.054677 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.054983 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.055402 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.055705 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.056034 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.056366 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.056696 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.057011 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.057306 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.057628 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.057936 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.058257 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.058602 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.058918 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.059286 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.059607 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.060249 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.060581 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.060899 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.061236 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.061565 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.061962 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.062327 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.062468 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.062792 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.063125 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.063435 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.063745 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.064058 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.064364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.064676 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.064984 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.065290 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.065596 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.065903 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.066213 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.066517 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.066822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.067165 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.067515 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.067834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.068151 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.068483 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.068780 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.069086 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.069391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.069697 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.070000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.070311 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.070637 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.070987 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.071271 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.071721 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.072104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.072337 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.072660 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.072967 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.073294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.073605 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.073916 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.074235 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.074545 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.074887 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.075261 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.075660 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.075985 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.076925 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.076925 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.076925 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.077220 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.077471 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.077775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.078075 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.078372 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.078676 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.078976 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.079335 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.079635 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.079936 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.080243 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.080541 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082013 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082013 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082013 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082013 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082013 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082811 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.082910 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.083201 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.083508 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.083807 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.084163 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.084484 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.084801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.085120 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.085430 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.085748 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.086055 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.086372 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.086691 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.087088 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.087334 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.087667 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.087978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.088722 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.088722 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.088925 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.089189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.089499 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.089831 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.090157 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.090463 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.090784 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.091168 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.091487 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.091800 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.092151 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.092441 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.092964 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.093081 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.093349 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.093674 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.093967 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.094281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.094593 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.094909 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.095248 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.095564 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.095886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.096208 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.096515 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.096838 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.097227 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.097508 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.097819 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.098161 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.098483 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.098794 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.099124 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.099428 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 05:42:55.099668 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 05:42:55.168313 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO dbcounter [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Registered counter for database nova_api Jul 21 05:42:55.191476 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_db.sqlalchemy.engines [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.198992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writer thread running {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.254710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.context [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c6f16-4900-4da5-aed7-50fb0037da9c(cell1) {{(pid=124328) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 05:42:55.258754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:42:55.260368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:42:55.261138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:42:55.262881 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO dbcounter [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Registered counter for database nova_api Jul 21 05:42:55.263257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:42:55.265258 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO dbcounter [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Registered counter for database nova_cell0 Jul 21 05:42:55.269277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO dbcounter [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Registered counter for database nova_cell1 Jul 21 05:42:55.276620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_db.sqlalchemy.engines [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.279866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_db.sqlalchemy.engines [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.282769 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writer thread running {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.284771 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_db.sqlalchemy.engines [None req-3a0f1077-f352-4160-a108-913a61189011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.291924 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writer thread running {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.347654 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.context [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c6f16-4900-4da5-aed7-50fb0037da9c(cell1) {{(pid=124329) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 05:42:55.351791 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:42:55.353389 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:42:55.354187 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:42:55.356263 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:42:55.358332 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO dbcounter [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Registered counter for database nova_cell0 Jul 21 05:42:55.362555 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO dbcounter [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Registered counter for database nova_cell1 Jul 21 05:42:55.369995 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_db.sqlalchemy.engines [None req-3a0f1077-f352-4160-a108-913a61189011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.372396 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_db.sqlalchemy.engines [None req-3a0f1077-f352-4160-a108-913a61189011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.377458 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writer thread running {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.380041 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writer thread running {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.418020 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writer thread running {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.428817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO dbcounter [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Registered counter for database nova_cell0 Jul 21 05:42:55.435773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_db.sqlalchemy.engines [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.440577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writer thread running {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.522791 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO dbcounter [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Registered counter for database nova_cell0 Jul 21 05:42:55.532022 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_db.sqlalchemy.engines [None req-3a0f1077-f352-4160-a108-913a61189011 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 05:42:55.537440 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writer thread running {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 05:42:55.753958 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: WARNING keystonemiddleware.auth_token [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:42:55.761347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: WARNING keystonemiddleware.auth_token [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:42:55.855240 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: WARNING keystonemiddleware.auth_token [None req-3a0f1077-f352-4160-a108-913a61189011 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:42:55.862535 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: WARNING keystonemiddleware.auth_token [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:42:56.101495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: WARNING keystonemiddleware.auth_token [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:42:56.108031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: WARNING keystonemiddleware.auth_token [None req-ed818b54-1216-41b6-83a1-124bf149f7a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:42:56.114658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55598be209c0 pid: 124328 (default app) Jul 21 05:42:56.210917 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: WARNING keystonemiddleware.auth_token [None req-3a0f1077-f352-4160-a108-913a61189011 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 05:42:56.217367 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: WARNING keystonemiddleware.auth_token [None req-3a0f1077-f352-4160-a108-913a61189011 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 05:42:56.223567 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55598be209c0 pid: 124329 (default app) Jul 21 05:43:37.142481 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:37.144200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:37.145150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:37.146956 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:37.457140 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=3 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:37.458562 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=3 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:37.461091 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=3 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:37.462114 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=3 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:43:38.393605 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4bda2a09-a8e4-48ca-a2ef-9650101f4666 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Action: 'create', calling method: .version_select at 0x7f5091c00ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-723519781"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:38.801975 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-98683896-c846-49e2-af4b-07fa8467b8df tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Action: 'create', calling method: .version_select at 0x7f5091c01ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-581862742", "metadata": {"Type": "work"}}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-98683896-c846-49e2-af4b-07fa8467b8df tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Request method failure captured: Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 121 Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeJqWLX-I64pk-Ln-3n71rh-ukudRGUko4zePmVaPJuPWuO4-GYC54bB_LtDzGATe-CWa7QApfv7DB6Ct2htFxdHqoqKJSCvJFlUnDXAvIXQBj2skdlCE1gI_bsUoOkAZTB2-AuJ1bQQRBsC5E-LsWgivN9KVBMP2GTDzTNELIxytc Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:43:38.831111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_28238eceb52e42d985df53b2ba8a42df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}] Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: 45e9f4e991814209a322a78136e9bf19 Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-581862742", "metadata": {"Type": "work"}}} Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: Jul 21 05:43:38.832825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-581862742', 'metadata': {'Type': 'work'}}}} Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise error Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:43:38.833799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 05:43:38.835501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 05:43:38.836989 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 05:43:38.836989 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.836989 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-98683896-c846-49e2-af4b-07fa8467b8df tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:43:38.837900 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-98683896-c846-49e2-af4b-07fa8467b8df tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.387489 Jul 21 05:43:38.838546 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 05:43:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1389 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 05:43:38.847991 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-7edd8714-76f2-45bb-ae10-e132a6419ec5 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Action: 'create', calling method: .version_select at 0x7f5091ba8f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1415451103", "metadata": {"Type": "work"}}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-7edd8714-76f2-45bb-ae10-e132a6419ec5 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Request method failure captured: Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 120 Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeJqWLX-I64pk-Ln-3n71rh-ukudRGUko4zePmVaPJuPWuO4-GYC54bB_LtDzGATe-CWa7QApfv7DB6Ct2htFxdHqoqKJSCvJFlUnDXAvIXQBj2skdlCE1gI_bsUoOkAZTB2-AuJ1bQQRBsC5E-LsWgivN9KVBMP2GTDzTNELIxytc Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:43:38.850815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_28238eceb52e42d985df53b2ba8a42df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}] Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: 45e9f4e991814209a322a78136e9bf19 Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1415451103", "metadata": {"Type": "work"}}} Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: Jul 21 05:43:38.852386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1415451103', 'metadata': {'Type': 'work'}}}} Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise error Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi '0' Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:43:38.853308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 05:43:38.854835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 05:43:38.856183 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 05:43:38.856183 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.856183 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-7edd8714-76f2-45bb-ae10-e132a6419ec5 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:43:38.859880 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-7edd8714-76f2-45bb-ae10-e132a6419ec5 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015709 Jul 21 05:43:38.860578 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 2/2] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 05:43:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 05:43:38.869518 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-be7145d7-000f-4750-9a2b-f24ab20a4c3b tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Action: 'create', calling method: .version_select at 0x7f5091ba80d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-606559615", "metadata": {"Type": "work"}}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-be7145d7-000f-4750-9a2b-f24ab20a4c3b tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Request method failure captured: Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 118 Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeJqWLX-I64pk-Ln-3n71rh-ukudRGUko4zePmVaPJuPWuO4-GYC54bB_LtDzGATe-CWa7QApfv7DB6Ct2htFxdHqoqKJSCvJFlUnDXAvIXQBj2skdlCE1gI_bsUoOkAZTB2-AuJ1bQQRBsC5E-LsWgivN9KVBMP2GTDzTNELIxytc Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:43:38.874223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_28238eceb52e42d985df53b2ba8a42df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}] Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: 45e9f4e991814209a322a78136e9bf19 Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-606559615", "metadata": {"Type": "work"}}} Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: Jul 21 05:43:38.876272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-606559615', 'metadata': {'Type': 'work'}}}} Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise error Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi '' Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:43:38.877008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 05:43:38.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 05:43:38.880453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 05:43:38.880453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:38.881600 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-be7145d7-000f-4750-9a2b-f24ab20a4c3b tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:43:38.884416 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-be7145d7-000f-4750-9a2b-f24ab20a4c3b tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017850 Jul 21 05:43:38.887559 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 3/3] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 05:43:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 05:43:38.898742 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-cae3f301-9031-4b05-87a5-73a4cb8c7e88 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Calling method '.version_select at 0x7f5091aadca0>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:40.566294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.wsgi [None req-cae3f301-9031-4b05-87a5-73a4cb8c7e88 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] HTTP exception thrown: Volume tempest-invalid-1516151085 could not be found. Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-cae3f301-9031-4b05-87a5-73a4cb8c7e88 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Request method failure captured: Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1516151085 HTTP/1.1 Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 0 Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeJqWLX-I64pk-Ln-3n71rh-ukudRGUko4zePmVaPJuPWuO4-GYC54bB_LtDzGATe-CWa7QApfv7DB6Ct2htFxdHqoqKJSCvJFlUnDXAvIXQBj2skdlCE1gI_bsUoOkAZTB2-AuJ1bQQRBsC5E-LsWgivN9KVBMP2GTDzTNELIxytc Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:43:40.570309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_28238eceb52e42d985df53b2ba8a42df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}] Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: 45e9f4e991814209a322a78136e9bf19 Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Volume tempest-invalid-1516151085 could not be found. Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'id': 'tempest-invalid-1516151085'} Jul 21 05:43:40.571883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1516151085 could not be found. (HTTP 404) (Request-ID: req-2916bc3a-4f35-4b75-b00b-14950a94dd64) Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:40.572822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 05:43:40.574424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1516151085 could not be found. Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:43:40.575886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1516151085 could not be found. Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1516151085 could not be found. Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:40.577488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-cae3f301-9031-4b05-87a5-73a4cb8c7e88 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Returning 404 to user: Volume tempest-invalid-1516151085 could not be found. {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:43:40.579750 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-cae3f301-9031-4b05-87a5-73a4cb8c7e88 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1516151085" status: 404 len: 99 microversion: 2.1 time: 1.687021 Jul 21 05:43:40.579750 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 4/4] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jul 21 05:43:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1516151085 => generated 99 bytes in 1688 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 05:43:40.590429 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ca996181-6cb1-4536-871f-2565896b9714 tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004051 Jul 21 05:43:40.611845 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 5/5] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jul 21 05:43:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 05:43:40.619360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4bda2a09-a8e4-48ca-a2ef-9650101f4666 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.491901 Jul 21 05:43:40.622638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 1/6] 10.222.0.44 () {60 vars in 1154 bytes} [Thu Jul 21 05:43:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3497 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 05:43:40.634904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f7ec049e-7535-4768-9838-f9586faab70a tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5091a51af0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:40.648380 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-1cf53c0a-1f12-4c2c-b907-d462524327ca tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.024227 Jul 21 05:43:40.653974 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 6/7] 10.222.0.44 () {58 vars in 1136 bytes} [Thu Jul 21 05:43:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 05:43:40.666256 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-6c5f5df5-350c-493b-bbdb-869f4946fb9f tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Calling method '.version_select at 0x7f50919dcf70>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:41.743846 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.wsgi [None req-6c5f5df5-350c-493b-bbdb-869f4946fb9f tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] HTTP exception thrown: Volume e4e81b6f-d312-48f1-97ef-5d9a3196b17c could not be found. Jul 21 05:43:41.745780 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f7ec049e-7535-4768-9838-f9586faab70a tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 200 len: 344 microversion: 2.1 time: 1.115062 Jul 21 05:43:41.746678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 2/8] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:40 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 344 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-6c5f5df5-350c-493b-bbdb-869f4946fb9f tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Request method failure captured: Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: DELETE /compute/v2.1/os-volumes/e4e81b6f-d312-48f1-97ef-5d9a3196b17c HTTP/1.1 Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 0 Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeJqWLX-I64pk-Ln-3n71rh-ukudRGUko4zePmVaPJuPWuO4-GYC54bB_LtDzGATe-CWa7QApfv7DB6Ct2htFxdHqoqKJSCvJFlUnDXAvIXQBj2skdlCE1gI_bsUoOkAZTB2-AuJ1bQQRBsC5E-LsWgivN9KVBMP2GTDzTNELIxytc Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:43:41.751115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_28238eceb52e42d985df53b2ba8a42df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}] Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: 45e9f4e991814209a322a78136e9bf19 Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Volume e4e81b6f-d312-48f1-97ef-5d9a3196b17c could not be found. Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'id': 'e4e81b6f-d312-48f1-97ef-5d9a3196b17c'} Jul 21 05:43:41.752503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e4e81b6f-d312-48f1-97ef-5d9a3196b17c could not be found. (HTTP 404) (Request-ID: req-714a29ec-d8d0-4ecb-bbab-5549148cd398) Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:41.753486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 05:43:41.754740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e4e81b6f-d312-48f1-97ef-5d9a3196b17c could not be found. Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 05:43:41.755952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e4e81b6f-d312-48f1-97ef-5d9a3196b17c could not be found. Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e4e81b6f-d312-48f1-97ef-5d9a3196b17c could not be found. Jul 21 05:43:41.757014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:43:41.758190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-6c5f5df5-350c-493b-bbdb-869f4946fb9f tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Returning 404 to user: Volume e4e81b6f-d312-48f1-97ef-5d9a3196b17c could not be found. {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:43:41.759221 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-6c5f5df5-350c-493b-bbdb-869f4946fb9f tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e4e81b6f-d312-48f1-97ef-5d9a3196b17c" status: 404 len: 109 microversion: 2.1 time: 1.100361 Jul 21 05:43:41.760267 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 7/9] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 05:43:40 2022] DELETE /compute/v2.1/os-volumes/e4e81b6f-d312-48f1-97ef-5d9a3196b17c => generated 109 bytes in 1102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:43:41.769136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-90802973-fa7e-40ad-93d9-48a157fa352c tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Calling method '.version_select at 0x7f5091a51c10>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:42.195816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-90802973-fa7e-40ad-93d9-48a157fa352c tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] HTTP exception thrown: Volume 93ce04b2-aafe-497e-95c8-c013de9638dc could not be found. Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-90802973-fa7e-40ad-93d9-48a157fa352c tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Request method failure captured: Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/os-volumes/93ce04b2-aafe-497e-95c8-c013de9638dc HTTP/1.1 Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeJqWLX-I64pk-Ln-3n71rh-ukudRGUko4zePmVaPJuPWuO4-GYC54bB_LtDzGATe-CWa7QApfv7DB6Ct2htFxdHqoqKJSCvJFlUnDXAvIXQBj2skdlCE1gI_bsUoOkAZTB2-AuJ1bQQRBsC5E-LsWgivN9KVBMP2GTDzTNELIxytc Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:43:42.200125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_28238eceb52e42d985df53b2ba8a42df", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/28238eceb52e42d985df53b2ba8a42df"}]}] Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 28238eceb52e42d985df53b2ba8a42df Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesNegativeTest-999197538 Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 45e9f4e991814209a322a78136e9bf19 Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesNegativeTest-999197538-project Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Volume 93ce04b2-aafe-497e-95c8-c013de9638dc could not be found. Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '93ce04b2-aafe-497e-95c8-c013de9638dc'} Jul 21 05:43:42.201259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93ce04b2-aafe-497e-95c8-c013de9638dc could not be found. (HTTP 404) (Request-ID: req-3803fe88-cee3-43a8-ac0c-d3ff80d162a9) Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:42.202044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:43:42.203187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93ce04b2-aafe-497e-95c8-c013de9638dc could not be found. Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 05:43:42.204602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93ce04b2-aafe-497e-95c8-c013de9638dc could not be found. Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93ce04b2-aafe-497e-95c8-c013de9638dc could not be found. Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-90802973-fa7e-40ad-93d9-48a157fa352c tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] Returning 404 to user: Volume 93ce04b2-aafe-497e-95c8-c013de9638dc could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-90802973-fa7e-40ad-93d9-48a157fa352c tempest-VolumesNegativeTest-999197538 tempest-VolumesNegativeTest-999197538-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/93ce04b2-aafe-497e-95c8-c013de9638dc" status: 404 len: 109 microversion: 2.1 time: 0.436309 Jul 21 05:43:42.206181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 3/10] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:41 2022] GET /compute/v2.1/os-volumes/93ce04b2-aafe-497e-95c8-c013de9638dc => generated 109 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:43:42.758804 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-af4218b3-1b25-4563-aab8-2e1ef55e460a tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919f3310>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:42.871892 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-af4218b3-1b25-4563-aab8-2e1ef55e460a tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 200 len: 345 microversion: 2.1 time: 0.117387 Jul 21 05:43:42.872835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 8/11] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:42 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:42.886351 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4d21c278-9325-4d88-9466-537c158567e3 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Action: 'create', calling method: .version_select at 0x7f50923f20d0>, body: {"snapshot": {"volume_id": "74f278f5-aca1-4fa5-88de-f772601e09eb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1303789770"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:43.328896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4d21c278-9325-4d88-9466-537c158567e3 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.447492 Jul 21 05:43:43.329543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 4/12] 10.222.0.44 () {60 vars in 1161 bytes} [Thu Jul 21 05:43:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:43.340620 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-06f4f72a-d1cf-4127-956d-0ef0f8c9948f tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919f3940>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:43.479190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-06f4f72a-d1cf-4127-956d-0ef0f8c9948f tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.143385 Jul 21 05:43:43.479944 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 9/13] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:43 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:43.490511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3e3f5eb7-077b-46fa-b9dd-5312603f372d tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5091a40940>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:43.602540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3e3f5eb7-077b-46fa-b9dd-5312603f372d tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.116332 Jul 21 05:43:43.603375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 5/14] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jul 21 05:43:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:43.613697 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-10892524-82bd-4042-833b-6d6a44f21d8a tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919f3700>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:43.689587 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-10892524-82bd-4042-833b-6d6a44f21d8a tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.079397 Jul 21 05:43:43.690717 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 10/15] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:43 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:44.701572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a7d983bf-be2b-4714-806a-d091fb5503a5 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919dd670>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:44.801118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a7d983bf-be2b-4714-806a-d091fb5503a5 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.103383 Jul 21 05:43:44.802096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 6/16] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:44 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:45.307265 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9c5661bc-36e2-4586-9228-f989e0daf0b0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'create', calling method: .version_select at 0x7f50919dcd30>, body: {"keypair": {"name": "tempest-keypair-1785966693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpogzulaJG8IKw8iIBBCJxx06i9X+PJoB1x73sIB5KGgRbT0Ib4RwHkq0zpxH4dLrzihOFB8kUtjtRsn7zerGtegbHLZx5JjgPMdR9dmgyQaQXRz0GyPCnZ4Jbm4BzyWw=="}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:45.436784 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-9c5661bc-36e2-4586-9228-f989e0daf0b0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for project 7b88b7408762493e825c86d05b5e62bc. Resources: {'key_pairs'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:43:45.469648 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-9c5661bc-36e2-4586-9228-f989e0daf0b0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for user 0cbf797171144c139c72c516cea59bb9 and project 7b88b7408762493e825c86d05b5e62bc. Resources: {'key_pairs'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:43:45.556506 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9c5661bc-36e2-4586-9228-f989e0daf0b0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.437916 Jul 21 05:43:45.557146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 11/17] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jul 21 05:43:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 440 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 05:43:45.816195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-15aa279a-7660-4ff8-b823-2e56281dcc3d tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919dddc0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:45.894222 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-15aa279a-7660-4ff8-b823-2e56281dcc3d tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.084840 Jul 21 05:43:45.894805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 7/18] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:45 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:46.905919 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-affad94d-8add-4922-82da-4553580e254b tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5091954700>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:46.955998 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-affad94d-8add-4922-82da-4553580e254b tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.053883 Jul 21 05:43:46.957140 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 12/19] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:46 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:47.969355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f8e33b2f-af20-4427-95d5-675fd08dc31c tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919dd700>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:48.061678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f8e33b2f-af20-4427-95d5-675fd08dc31c tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.096797 Jul 21 05:43:48.062457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 8/20] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:47 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:48.527438 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1722784090", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "networks": [{"uuid": "150455e2-3815-4eb2-84e7-db0308f0030a"}]}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:48.727772 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.network.neutron [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] validate_networks() for [('150455e2-3815-4eb2-84e7-db0308f0030a', None, None, None, None, None)] {{(pid=124329) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:43:49.073672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b6df8005-fe04-4919-a1c4-f1589498368f tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919dd0d0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:49.142407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b6df8005-fe04-4919-a1c4-f1589498368f tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.064430 Jul 21 05:43:49.142407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 9/21] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:49 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:43:49.819116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-562044722", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9839c83c-0406-4627-8776-66ce5f345f2a"}], "security_groups": [{"name": "tempest-securitygroup--763974081"}], "key_name": "tempest-keypair-1785966693", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:50.274988 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] validate_networks() for [('9839c83c-0406-4627-8776-66ce5f345f2a', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:43:50.882509 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Flavor limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:43:50.884725 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Image limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:43:50.885474 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Flavor pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:43:50.886319 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Image pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:43:50.887245 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:43:50.924717 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:50.925371 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:50.926681 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:50.940062 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:51.021310 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Getting quotas for project 5a36ae0fd7b648158ce3fbe24d474ad7. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:43:51.053264 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Getting quotas for user d01f138c8f0d4940af6737d2576a7326 and project 5a36ae0fd7b648158ce3fbe24d474ad7. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:43:51.082791 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Going to run 1 instances... {{(pid=124329) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:43:51.085662 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:43:51.278870 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f2e41a97-fd0f-4355-ada7-e202f31cb45d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.089426 Jul 21 05:43:51.280181 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 13/22] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:43:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:43:51.288012 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-119c2216-7c17-47b7-a5be-233378668c3f tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50910a84c0>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:51.342378 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-119c2216-7c17-47b7-a5be-233378668c3f tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 288 microversion: 2.1 time: 0.060755 Jul 21 05:43:51.348055 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 14/23] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:51 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 288 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:51.357035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8922a4a2-8b07-49eb-80e2-c97c7c9a3b86 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:51.366174 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8922a4a2-8b07-49eb-80e2-c97c7c9a3b86 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:51.849423 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8922a4a2-8b07-49eb-80e2-c97c7c9a3b86 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:51.872974 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8922a4a2-8b07-49eb-80e2-c97c7c9a3b86 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1215 microversion: 2.1 time: 0.523543 Jul 21 05:43:51.887593 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 15/24] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:51 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1215 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:51.893762 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-92258ae8-5752-4d84-bb17-2b5011a226d2 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5091954820>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:52.045859 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-92258ae8-5752-4d84-bb17-2b5011a226d2 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 202 len: 0 microversion: 2.1 time: 0.154317 Jul 21 05:43:52.047284 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 16/25] 10.222.0.44 () {58 vars in 1253 bytes} [Thu Jul 21 05:43:51 2022] DELETE /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:43:52.073788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:43:52.074335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:43:52.074803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:43:52.076145 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:43:52.076574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:43:52.096837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:52.098741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:52.099890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:52.100604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:52.138390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for project 7b88b7408762493e825c86d05b5e62bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:43:52.150110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for user 0cbf797171144c139c72c516cea59bb9 and project 7b88b7408762493e825c86d05b5e62bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:43:52.171051 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:43:52.178327 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:43:52.410720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b2b33678-bac8-4806-b239-7c590ed366a7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.604339 Jul 21 05:43:52.411910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 10/26] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jul 21 05:43:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 21 05:43:52.427996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9bde5f37-fcdf-4ef0-991a-d0420af16912 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50910ef1f0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:52.433070 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-92794587", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:52.547662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9bde5f37-fcdf-4ef0-991a-d0420af16912 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.132125 Jul 21 05:43:52.549034 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 11/27] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:52 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:52.578435 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.network.neutron [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] validate_networks() for [('dcd68d6c-76ec-4044-ad63-fb25660c694c', None, None, None, None, None)] {{(pid=124329) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:43:52.578837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c82aa761-d5e7-4adb-bf38-fa5ba31c6da0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:52.581158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c82aa761-d5e7-4adb-bf38-fa5ba31c6da0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:52.816596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c82aa761-d5e7-4adb-bf38-fa5ba31c6da0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:52.858472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c82aa761-d5e7-4adb-bf38-fa5ba31c6da0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:52.860068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c82aa761-d5e7-4adb-bf38-fa5ba31c6da0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:52.861308 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c82aa761-d5e7-4adb-bf38-fa5ba31c6da0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1281 microversion: 2.20 time: 0.310714 Jul 21 05:43:52.861971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 12/28] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:43:52 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1281 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:43:52.894182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c0b58494-5537-4686-a5b7-8b99608a05ce tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:52.900762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c0b58494-5537-4686-a5b7-8b99608a05ce tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:53.108073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c0b58494-5537-4686-a5b7-8b99608a05ce tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:53.117207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c0b58494-5537-4686-a5b7-8b99608a05ce tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1215 microversion: 2.1 time: 0.225447 Jul 21 05:43:53.118615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 13/29] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:52 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1215 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:53.560896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-85d125c3-f5d4-47b2-a3a1-06017e362320 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f509089f3a0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:53.682749 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Flavor limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:43:53.683819 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Image limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:43:53.684448 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Flavor pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:43:53.685258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Image pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:43:53.685966 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:43:53.704931 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:53.708096 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:53.710830 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:53.712512 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:53.740609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-85d125c3-f5d4-47b2-a3a1-06017e362320 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 200 len: 287 microversion: 2.1 time: 0.185184 Jul 21 05:43:53.743448 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 14/30] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:53 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:53.766076 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for project da2259120cca423686fd6e54d0ad2257. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:43:53.786263 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for user 563f1367093e493bae87a21374a3c2f3 and project da2259120cca423686fd6e54d0ad2257. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:43:53.821698 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Going to run 1 instances... {{(pid=124329) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:43:53.827246 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:43:53.885516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ede521fc-1ebb-4cfb-8f6f-ff03aefef721 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:53.886154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ede521fc-1ebb-4cfb-8f6f-ff03aefef721 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:53.952793 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-aeb7ab6b-c0e6-45e0-90e5-ebdfe348b2de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.900455 Jul 21 05:43:53.957236 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 17/31] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:43:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:43:53.972863 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8064c7ef-49d8-4620-96cb-df72b4375c8c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:53.976377 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8064c7ef-49d8-4620-96cb-df72b4375c8c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:54.051877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ede521fc-1ebb-4cfb-8f6f-ff03aefef721 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:54.065479 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ede521fc-1ebb-4cfb-8f6f-ff03aefef721 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:54.068751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ede521fc-1ebb-4cfb-8f6f-ff03aefef721 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:54.072727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ede521fc-1ebb-4cfb-8f6f-ff03aefef721 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1281 microversion: 2.20 time: 0.195872 Jul 21 05:43:54.073528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 15/32] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:43:53 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:43:54.139551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:54.140371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:54.162096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:54.164175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:54.165021 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:54.165456 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:54.173815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8064c7ef-49d8-4620-96cb-df72b4375c8c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:54.182953 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8064c7ef-49d8-4620-96cb-df72b4375c8c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1220 microversion: 2.1 time: 0.220729 Jul 21 05:43:54.186986 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 18/33] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:53 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1220 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:54.513174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:54.548201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3d41aa06-c0b2-494b-8a21-940d6df95dae tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1211 microversion: 2.1 time: 0.413115 Jul 21 05:43:54.561812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 16/34] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:54 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1211 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:43:54.708592 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-723619651", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:43:54.755743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4531a1b1-52fa-47e3-aecc-8d862191ca28 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5090803f70>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:54.900947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-4531a1b1-52fa-47e3-aecc-8d862191ca28 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] HTTP exception thrown: Snapshot c395835c-fc7e-4ff0-8d6a-a8ad982bc5df could not be found. Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4531a1b1-52fa-47e3-aecc-8d862191ca28 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Request method failure captured: Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df HTTP/1.1 Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeIRRgdZ75MLJy6k697UmxvwQvoAxy8aPQlG5_aumyDJ78dGIDObSN-_Qy5jo_uiqqT2Ojrj1DXWsubwDwv9npuTRINj9ReMOUGjRDVaaQNO8NEGgEG9W8fpaXwQs1S3X8q3B_mN-wEMVYH629J-c3flka3EZf901iqgiq_MVeEXuA Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:43:54.912543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_56e1c60a9af04d57a84e220a9add1553", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}] Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 7e08156ce92b49df803ea339b6b4c786 Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Snapshot c395835c-fc7e-4ff0-8d6a-a8ad982bc5df could not be found. Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'c395835c-fc7e-4ff0-8d6a-a8ad982bc5df'} Jul 21 05:43:54.913699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c395835c-fc7e-4ff0-8d6a-a8ad982bc5df could not be found. (HTTP 404) (Request-ID: req-b9ef607f-63fa-424d-851c-07c704c69d2f) Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:54.914428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:43:54.915474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c395835c-fc7e-4ff0-8d6a-a8ad982bc5df could not be found. Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 05:43:54.916421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c395835c-fc7e-4ff0-8d6a-a8ad982bc5df could not be found. Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c395835c-fc7e-4ff0-8d6a-a8ad982bc5df could not be found. Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4531a1b1-52fa-47e3-aecc-8d862191ca28 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Returning 404 to user: Snapshot c395835c-fc7e-4ff0-8d6a-a8ad982bc5df could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4531a1b1-52fa-47e3-aecc-8d862191ca28 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df" status: 404 len: 111 microversion: 2.1 time: 0.164402 Jul 21 05:43:54.917507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 17/35] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:43:54 2022] GET /compute/v2.1/os-snapshots/c395835c-fc7e-4ff0-8d6a-a8ad982bc5df => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 05:43:54.935641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bcf62fb7-47e7-420e-a39c-0daacc7c18f1 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5090803ee0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:54.937146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.network.neutron [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] validate_networks() for [('dcd68d6c-76ec-4044-ad63-fb25660c694c', None, None, None, None, None)] {{(pid=124329) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:43:55.130656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bcf62fb7-47e7-420e-a39c-0daacc7c18f1 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 202 len: 0 microversion: 2.1 time: 0.200867 Jul 21 05:43:55.131314 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 18/36] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 05:43:54 2022] DELETE /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:43:55.136558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:55.141476 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:55.159112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:55.165002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:55.165632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:55.165982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:55.355231 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:55.364844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:55.366820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:55.368194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b8bb6cdd-4dee-4f6c-8986-44a4b49e7311 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1277 microversion: 2.20 time: 0.235790 Jul 21 05:43:55.368986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 19/37] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:43:55 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1277 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:43:55.373873 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f580ddcc-ea9f-4543-9929-361e05312eed tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f509081db80>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:55.441218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f580ddcc-ea9f-4543-9929-361e05312eed tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 200 len: 344 microversion: 2.1 time: 0.070859 Jul 21 05:43:55.442551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 20/38] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:55 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:55.572853 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:55.576115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:55.591102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:55.592005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:55.592882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:55.593315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:55.798517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:55.808202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-52c35892-ada1-442e-bbe8-b932bbdfb92c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1267 microversion: 2.1 time: 0.243734 Jul 21 05:43:55.830666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 21/39] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:55 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:55.881731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Flavor limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:43:55.882248 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Image limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:43:55.882660 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Flavor pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:43:55.883074 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Image pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:43:55.883601 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:43:55.901597 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:55.902051 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:55.902896 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:55.903353 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:55.925168 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for project da2259120cca423686fd6e54d0ad2257. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:43:55.930475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for user 563f1367093e493bae87a21374a3c2f3 and project da2259120cca423686fd6e54d0ad2257. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:43:55.953638 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Going to run 1 instances... {{(pid=124329) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:43:55.956734 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:43:56.033648 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b1cba222-feff-4a70-9c79-eaa206f8e74e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.331063 Jul 21 05:43:56.039415 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 19/40] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:43:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:43:56.048242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b82cfe86-fa06-4ad9-9e77-20faba248ad0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:56.048852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b82cfe86-fa06-4ad9-9e77-20faba248ad0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:56.165749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b82cfe86-fa06-4ad9-9e77-20faba248ad0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:56.178524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b82cfe86-fa06-4ad9-9e77-20faba248ad0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1221 microversion: 2.1 time: 0.134305 Jul 21 05:43:56.180331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 22/41] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:56 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1221 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:43:56.388478 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:56.390124 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:56.398912 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:56.400051 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:56.402492 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:56.404202 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:56.464914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-94b9efde-dbc6-41b1-92d9-a24ebcc11748 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50907e1d30>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:56.557107 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-94b9efde-dbc6-41b1-92d9-a24ebcc11748 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 200 len: 344 microversion: 2.1 time: 0.107059 Jul 21 05:43:56.562879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 23/42] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:56 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:43:56.607695 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:56.626755 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:56.631353 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:56.632572 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d4c679d8-2648-4ab5-96fb-cc1cc65c3e24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1277 microversion: 2.20 time: 0.249661 Jul 21 05:43:56.633396 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 20/43] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:43:56 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:43:56.829237 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:56.829381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:56.842342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:56.845695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:56.845695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:56.845695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:56.929588 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:56.937317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-642ad356-6877-473a-a5d2-58637adcf44d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1267 microversion: 2.1 time: 0.112649 Jul 21 05:43:56.938326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 24/44] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:56 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1267 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:57.195920 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:57.197638 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:57.210114 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:57.210685 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:57.213005 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:57.213546 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:57.288931 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:57.296863 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-dfa6851b-3bf0-4292-a282-aa58ad923826 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1225 microversion: 2.1 time: 0.104924 Jul 21 05:43:57.297449 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 21/45] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:57 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:57.569968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c0a26316-c487-404a-980b-3df4d1a24964 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5090810af0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:57.650802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c0a26316-c487-404a-980b-3df4d1a24964 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 200 len: 344 microversion: 2.1 time: 0.084487 Jul 21 05:43:57.651897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 25/46] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:57 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:57.655892 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:57.657299 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:57.665609 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:57.665798 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:57.666666 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:57.667522 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:57.745146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:57.757590 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:57.762307 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:57.765724 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-0de27d1d-0551-4b45-9b43-8d845e1c6a7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1277 microversion: 2.20 time: 0.117377 Jul 21 05:43:57.766545 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 22/47] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:43:57 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:43:57.954610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:57.955365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:57.965342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:57.965892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:57.966728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:57.967299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:58.046030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:58.053740 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-086aec82-ef9e-4ef4-9189-76991ecfc545 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1267 microversion: 2.1 time: 0.103889 Jul 21 05:43:58.054313 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 26/48] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:57 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:58.315503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:58.316851 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:58.326150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:58.326682 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:58.327739 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:58.328319 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:58.401947 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:58.411109 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a8c88ce8-2212-4389-932a-6e829e8608c0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1225 microversion: 2.1 time: 0.100590 Jul 21 05:43:58.411774 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 23/49] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:58 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:58.673921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2de71ace-b4e1-449a-9394-acc2989fd9df tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5090810940>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:58.782472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2de71ace-b4e1-449a-9394-acc2989fd9df tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 200 len: 344 microversion: 2.1 time: 0.120978 Jul 21 05:43:58.783753 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 27/50] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:58 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 344 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:43:58.788689 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:58.789401 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:58.799001 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:58.799816 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:58.801561 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:58.802047 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:58.962831 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:58.976754 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:58.978300 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:58.981535 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-0800352e-4f33-4be8-9bd3-3d3a4175767c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1277 microversion: 2.20 time: 0.198961 Jul 21 05:43:58.982112 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 24/51] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:43:58 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:43:59.073128 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:59.073899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:59.084677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:59.086908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:59.088581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:59.091194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:59.271240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:59.286104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bd65ef44-1368-4b52-adcb-0f584cc3275f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1285 microversion: 2.1 time: 0.216690 Jul 21 05:43:59.296724 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 28/52] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:59 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:59.434722 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:59.435421 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:43:59.442888 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:59.444292 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:59.445645 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:43:59.446306 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:43:59.796001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7a78c806-4151-47a7-89d9-973d1a354e19 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5090810940>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:43:59.820903 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:43:59.831794 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-95da8e45-05dd-4abd-aef0-113636e131b2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1273 microversion: 2.1 time: 0.405512 Jul 21 05:43:59.833680 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 25/53] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:43:59 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1273 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:43:59.888064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7a78c806-4151-47a7-89d9-973d1a354e19 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 200 len: 344 microversion: 2.1 time: 0.095903 Jul 21 05:43:59.888816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 29/54] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:43:59 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:44:00.002529 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:00.003496 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:00.010378 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:00.011194 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:00.012169 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:00.012796 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:00.259917 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:00.294612 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:00.303614 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:00.304977 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a8ac8b44-9e65-4185-be59-e4c6473ea7c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1351 microversion: 2.20 time: 0.308694 Jul 21 05:44:00.305764 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 26/55] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:43:59 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1351 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:00.313400 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:00.314094 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:00.324699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:00.325394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:00.328081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:00.329621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:00.850896 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:00.852591 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:00.874557 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:00.884446 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:00.886387 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:00.886837 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:00.940895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:00.951546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f3e8afad-bb13-4f53-a96c-d349eb476acf tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.641773 Jul 21 05:44:00.952607 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 30/56] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:00 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:00.963636 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ef5d7ad3-6de3-4830-9602-b9d3844caef6 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50907e1d30>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:01.030183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-ef5d7ad3-6de3-4830-9602-b9d3844caef6 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] HTTP exception thrown: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ef5d7ad3-6de3-4830-9602-b9d3844caef6 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Request method failure captured: Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb HTTP/1.1 Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeIRRgdZ75MLJy6k697UmxvwQvoAxy8aPQlG5_aumyDJ78dGIDObSN-_Qy5jo_uiqqT2Ojrj1DXWsubwDwv9npuTRINj9ReMOUGjRDVaaQNO8NEGgEG9W8fpaXwQs1S3X8q3B_mN-wEMVYH629J-c3flka3EZf901iqgiq_MVeEXuA Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:44:01.032690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_56e1c60a9af04d57a84e220a9add1553", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}] Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 7e08156ce92b49df803ea339b6b4c786 Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '74f278f5-aca1-4fa5-88de-f772601e09eb'} Jul 21 05:44:01.033844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. (HTTP 404) (Request-ID: req-e2da84ca-940b-4482-8e71-f1cac35e5178) Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.034540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:44:01.035899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 05:44:01.039379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ef5d7ad3-6de3-4830-9602-b9d3844caef6 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Returning 404 to user: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:44:01.041247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ef5d7ad3-6de3-4830-9602-b9d3844caef6 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 404 len: 109 microversion: 2.1 time: 0.080545 Jul 21 05:44:01.043909 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 31/57] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:44:00 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:44:01.052695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dfa2eeed-0847-4adb-a697-dddf2e50d908 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f5090810f70>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:01.104125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-dfa2eeed-0847-4adb-a697-dddf2e50d908 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] HTTP exception thrown: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dfa2eeed-0847-4adb-a697-dddf2e50d908 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Request method failure captured: Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb HTTP/1.1 Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeIRRgdZ75MLJy6k697UmxvwQvoAxy8aPQlG5_aumyDJ78dGIDObSN-_Qy5jo_uiqqT2Ojrj1DXWsubwDwv9npuTRINj9ReMOUGjRDVaaQNO8NEGgEG9W8fpaXwQs1S3X8q3B_mN-wEMVYH629J-c3flka3EZf901iqgiq_MVeEXuA Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:44:01.106292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_56e1c60a9af04d57a84e220a9add1553", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}] Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 7e08156ce92b49df803ea339b6b4c786 Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '74f278f5-aca1-4fa5-88de-f772601e09eb'} Jul 21 05:44:01.107861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. (HTTP 404) (Request-ID: req-4291bb99-712d-4083-9f90-1c164f8a0ebd) Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.108669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 05:44:01.109862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 05:44:01.111269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.112406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.115433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dfa2eeed-0847-4adb-a697-dddf2e50d908 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Returning 404 to user: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:44:01.116707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dfa2eeed-0847-4adb-a697-dddf2e50d908 tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 404 len: 109 microversion: 2.1 time: 0.071604 Jul 21 05:44:01.117909 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 32/58] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 05:44:01 2022] DELETE /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:44:01.131332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-919f29cd-43de-4ad9-a529-4ce6c561fc9e tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Calling method '.version_select at 0x7f50919585e0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:01.196242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-919f29cd-43de-4ad9-a529-4ce6c561fc9e tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] HTTP exception thrown: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-919f29cd-43de-4ad9-a529-4ce6c561fc9e tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Request method failure captured: Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb HTTP/1.1 Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeIRRgdZ75MLJy6k697UmxvwQvoAxy8aPQlG5_aumyDJ78dGIDObSN-_Qy5jo_uiqqT2Ojrj1DXWsubwDwv9npuTRINj9ReMOUGjRDVaaQNO8NEGgEG9W8fpaXwQs1S3X8q3B_mN-wEMVYH629J-c3flka3EZf901iqgiq_MVeEXuA Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:44:01.198183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_56e1c60a9af04d57a84e220a9add1553", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/56e1c60a9af04d57a84e220a9add1553"}]}] Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 56e1c60a9af04d57a84e220a9add1553 Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-36140446 Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 7e08156ce92b49df803ea339b6b4c786 Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesSnapshotsTestJSON-36140446-project Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '74f278f5-aca1-4fa5-88de-f772601e09eb'} Jul 21 05:44:01.199578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. (HTTP 404) (Request-ID: req-0dc85a97-18a5-4bf5-a6bf-10b722ce8d66) Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.200394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:44:01.201616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 05:44:01.202779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. Jul 21 05:44:01.203984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:44:01.205804 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-919f29cd-43de-4ad9-a529-4ce6c561fc9e tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] Returning 404 to user: Volume 74f278f5-aca1-4fa5-88de-f772601e09eb could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:44:01.207137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-919f29cd-43de-4ad9-a529-4ce6c561fc9e tempest-VolumesSnapshotsTestJSON-36140446 tempest-VolumesSnapshotsTestJSON-36140446-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb" status: 404 len: 109 microversion: 2.1 time: 0.081402 Jul 21 05:44:01.208016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 33/59] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:44:01 2022] GET /compute/v2.1/os-volumes/74f278f5-aca1-4fa5-88de-f772601e09eb => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:44:01.253827 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:01.268098 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-de337fb7-d011-4ca7-ab43-315717580863 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1279 microversion: 2.1 time: 0.419458 Jul 21 05:44:01.269189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 27/60] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:00 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1279 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:01.325840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:01.327746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:01.343358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:01.344992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:01.348497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:01.349137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:01.865806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:01.880159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:01.885521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:01.887511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ecaf957b-e8da-4b0d-80c1-418ab45014c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1339 microversion: 2.20 time: 0.566767 Jul 21 05:44:01.889124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 34/61] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:01 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1339 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:01.975504 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:01.976478 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:01.995555 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:01.998866 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:02.000047 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:02.000612 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:02.288876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:02.289884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:02.292783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:02.318852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:02.321798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:02.325184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:02.329527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:02.800133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:02.820517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-92ed4039-39f4-4ec1-bb49-8f1aba3a6195 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1279 microversion: 2.1 time: 0.537599 Jul 21 05:44:02.821309 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 35/62] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:02 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1279 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:02.907283 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:02.908171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:02.916083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:02.924733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:02.925851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:02.926435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:02.953039 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:03.001766 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f306af46-cb1d-4aad-a9c2-394772232313 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 1.033051 Jul 21 05:44:03.005556 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 28/63] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:01 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:03.184320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:03.199953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:03.201930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:03.203455 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c181498d-631e-43bc-ad9f-02d154a58b44 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1339 microversion: 2.20 time: 0.300276 Jul 21 05:44:03.217390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 36/64] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:02 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1339 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:03.837703 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:03.838638 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:03.851558 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:03.852008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:03.852804 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:03.853232 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:04.019904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:04.020427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:04.028161 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:04.028633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:04.029421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:04.029883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:04.319483 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:04.346580 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-41522363-22f5-4e87-a9de-67d41846cd92 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1279 microversion: 2.1 time: 0.512622 Jul 21 05:44:04.350021 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 29/65] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:03 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1279 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:04.363257 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:04.364347 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:04.384484 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:04.386723 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:04.388593 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:04.392294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:04.980914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:04.986470 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:04.991497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d2ca54f0-2c22-4677-9f7a-12561dd672a5 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.973691 Jul 21 05:44:04.993275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 37/66] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:04 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:04.994492 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:04.996039 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:04.997141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f17b0f33-73b5-47e2-a2c2-14e58d7c3994 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.645919 Jul 21 05:44:04.997695 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 30/67] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:04 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:05.366468 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:05.367393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:05.374108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:05.385129 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:05.387365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:05.387798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:05.677925 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:05.687076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cff7fd56-9750-4e26-8558-dd0dfb49fe47 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.325272 Jul 21 05:44:05.688733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 38/68] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:05 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:05.768792 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-4dc4bf07-364f-4ff2-9231-2e958659b57b req-5711069d-632d-440a-bf9f-27e806c9dd2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69b4b556-e093-4708-85ec-1ae5cf887089", "tag": "6c81cf21-db6f-463e-b1ee-0c72d08f41ad"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:05.790355 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-4dc4bf07-364f-4ff2-9231-2e958659b57b req-5711069d-632d-440a-bf9f-27e806c9dd2e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:05.790801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-4dc4bf07-364f-4ff2-9231-2e958659b57b req-5711069d-632d-440a-bf9f-27e806c9dd2e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:05.813606 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-4dc4bf07-364f-4ff2-9231-2e958659b57b req-5711069d-632d-440a-bf9f-27e806c9dd2e service nova] Creating event network-changed:6c81cf21-db6f-463e-b1ee-0c72d08f41ad for instance 69b4b556-e093-4708-85ec-1ae5cf887089 on hv-cinder-85044 Jul 21 05:44:05.814138 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-4dc4bf07-364f-4ff2-9231-2e958659b57b req-5711069d-632d-440a-bf9f-27e806c9dd2e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124329) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 05:44:05.815265 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d9a54bd3-fc5e-4e6c-8952-086e69dc1e39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:05.815908 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d9a54bd3-fc5e-4e6c-8952-086e69dc1e39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:05.816760 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d9a54bd3-fc5e-4e6c-8952-086e69dc1e39 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:05.817179 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d9a54bd3-fc5e-4e6c-8952-086e69dc1e39 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:05.827193 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.compute.rpcapi [None req-d9a54bd3-fc5e-4e6c-8952-086e69dc1e39 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 05:44:05.828083 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d9a54bd3-fc5e-4e6c-8952-086e69dc1e39 None None] Releasing lock "compute-rpcapi-router" {{(pid=124329) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 05:44:05.844832 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d9a54bd3-fc5e-4e6c-8952-086e69dc1e39 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153174 Jul 21 05:44:05.845757 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 31/69] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:06.008792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:06.010641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:06.016404 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:06.016997 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:06.017823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:06.018476 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:06.019529 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:06.020343 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:06.027059 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=26 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:06.041939 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:06.042395 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:06.043377 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:06.043813 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:06.175218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=14 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:06.223215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:06.234610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bca5fb40-b392-4e61-8b19-fa9c61aa9390 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.229426 Jul 21 05:44:06.235662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 39/70] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:06 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:06.244447 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:06.253875 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:06.255558 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:06.256959 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-0d3c7d9a-e7b5-46b8-bf0d-b42399cb8221 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.243691 Jul 21 05:44:06.257535 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 32/71] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:06 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:06.705104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:06.705669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:06.712229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:06.712888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:06.713818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:06.714258 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:06.887795 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:06.895364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-72a0cb0c-9fd5-4307-a0eb-72e3d6184e6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.194453 Jul 21 05:44:06.899149 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 40/72] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:06 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:07.252901 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:07.253540 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:07.259595 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:07.260038 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:07.260796 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:07.261219 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:07.276645 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:07.277638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:07.286055 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:07.286755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:07.287744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:07.288459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:07.499865 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:07.517997 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-505499c8-8b8c-46bd-bda4-b7313001e620 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.269505 Jul 21 05:44:07.518735 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 33/73] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:07 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:07.533864 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:07.544569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:07.546880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:07.548503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-92d84e86-caac-4997-aa52-b39c4cc60732 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.277053 Jul 21 05:44:07.549367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 41/74] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:07 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:07.913522 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:07.914231 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:07.916376 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:07.922604 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:07.923077 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:07.923845 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:07.924277 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:08.080766 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:08.090433 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5ae531a0-2205-4bc9-9de4-8ec37fab8dd9 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.181292 Jul 21 05:44:08.091042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 34/75] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:07 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:08.539186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:08.539856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:08.552148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:08.553197 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:08.554336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:08.555314 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:08.567554 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:08.568707 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:08.580000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:08.582930 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:08.587491 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:08.588118 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:08.908791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:08.921489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ebd01e35-4189-4805-af07-6583a4f262ab tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.389013 Jul 21 05:44:08.922069 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 42/76] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:08 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:08.964544 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:08.972432 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=100 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:08.978581 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:08.980919 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:08.982394 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a0c234a2-417f-4d72-960b-82d631ab4227 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.418980 Jul 21 05:44:08.983301 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 35/77] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:08 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:09.109552 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:09.110527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:09.120854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:09.121301 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:09.122074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:09.122512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:09.164928 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:09.353058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:09.385746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2f4f750e-2de6-42c5-88b8-a0771e88a76f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.278836 Jul 21 05:44:09.387415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 43/78] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:09 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:09.940202 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:09.941105 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:09.972976 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:09.973606 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:09.974640 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:09.975526 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:10.004477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:10.005192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:10.021129 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:10.024597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:10.032397 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:10.034447 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:10.300401 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:10.312125 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-25c6fd57-c646-404a-a6ec-5ac6a7ae7393 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.377223 Jul 21 05:44:10.313201 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 36/79] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:09 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:10.356338 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:10.366215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:10.368024 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:10.371280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1300d13b-f6b5-4e72-81d5-fba976b27125 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.372475 Jul 21 05:44:10.372075 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 44/80] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:09 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:10.404296 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:10.404974 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:10.416261 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:10.419493 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:10.420530 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:10.421547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:10.998157 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:11.011885 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-7e9dbeed-1287-449f-a6dc-dc8c3fda4b40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.611424 Jul 21 05:44:11.012796 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 37/81] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:10 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:11.330061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:11.330973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:11.342190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:11.342635 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:11.343441 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:11.343876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:11.403103 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:11.404087 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:11.430318 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:11.430759 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:11.434400 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:11.434899 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:12.072898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:12.083820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-23e325b4-40bd-4887-af35-7ed044f8f74f tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.757715 Jul 21 05:44:12.087301 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 45/82] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:11 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:12.094397 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:12.099659 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:12.116632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:12.117424 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:12.120839 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:12.121561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:12.264974 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:12.278672 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:12.293220 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:12.296853 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f8b99911-6129-4cc4-93b2-c6da423d64ef tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.910207 Jul 21 05:44:12.300182 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 38/83] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:11 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:12.575045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:12.588653 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6628f921-ea6b-4cf2-8e9e-1b43f8d46040 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.500005 Jul 21 05:44:12.589493 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 46/84] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:12 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:12.636805 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-b836dfe8-6d2f-465c-bd88-3646a9fab0ca req-6a40322b-731e-4dfd-af33-894384095745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456", "tag": "2202ada8-e4b3-4035-bfb8-6abb7d693047"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:12.652012 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-b836dfe8-6d2f-465c-bd88-3646a9fab0ca req-6a40322b-731e-4dfd-af33-894384095745 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:12.657146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-b836dfe8-6d2f-465c-bd88-3646a9fab0ca req-6a40322b-731e-4dfd-af33-894384095745 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:12.686289 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-b836dfe8-6d2f-465c-bd88-3646a9fab0ca req-6a40322b-731e-4dfd-af33-894384095745 service nova] Creating event network-changed:2202ada8-e4b3-4035-bfb8-6abb7d693047 for instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 on hv-cinder-85044 Jul 21 05:44:12.700861 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-b836dfe8-6d2f-465c-bd88-3646a9fab0ca req-6a40322b-731e-4dfd-af33-894384095745 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067312 Jul 21 05:44:12.701793 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 39/85] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:13.105533 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:13.106522 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:13.108041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-1405d997-5b8c-47cd-ac80-cc3f886be4ee req-9f70e3dd-07a4-4bf4-b9e2-1d1af4ba02e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c3106a-0a81-4575-b1a7-dc0fc54551e2", "tag": "38bd4456-0aed-49a5-99eb-1bfcf154ecc0"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:13.122026 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.127742 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.128597 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.129033 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.137669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1405d997-5b8c-47cd-ac80-cc3f886be4ee req-9f70e3dd-07a4-4bf4-b9e2-1d1af4ba02e1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.139064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1405d997-5b8c-47cd-ac80-cc3f886be4ee req-9f70e3dd-07a4-4bf4-b9e2-1d1af4ba02e1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.177155 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-1405d997-5b8c-47cd-ac80-cc3f886be4ee req-9f70e3dd-07a4-4bf4-b9e2-1d1af4ba02e1 service nova] Creating event network-changed:38bd4456-0aed-49a5-99eb-1bfcf154ecc0 for instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 on hv-cinder-85044 Jul 21 05:44:13.177692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1405d997-5b8c-47cd-ac80-cc3f886be4ee req-9f70e3dd-07a4-4bf4-b9e2-1d1af4ba02e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 05:44:13.181798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01f46ce2-83b3-4770-b3a4-2e5dd934e9b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.184638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01f46ce2-83b3-4770-b3a4-2e5dd934e9b4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.185398 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01f46ce2-83b3-4770-b3a4-2e5dd934e9b4 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.185869 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01f46ce2-83b3-4770-b3a4-2e5dd934e9b4 None None] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.221359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.compute.rpcapi [None req-01f46ce2-83b3-4770-b3a4-2e5dd934e9b4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 05:44:13.222315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01f46ce2-83b3-4770-b3a4-2e5dd934e9b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=124328) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 05:44:13.278364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-01f46ce2-83b3-4770-b3a4-2e5dd934e9b4 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309175 Jul 21 05:44:13.279665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 47/86] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:13.340986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:13.341994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:13.353680 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.359460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.360592 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.361364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.587965 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:13.598731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c1a9346f-7461-4d96-ba1d-0aaa0c0b3d6e tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.497409 Jul 21 05:44:13.610095 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 40/87] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:13 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:13.615855 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:13.617000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:13.626433 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.626978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.627967 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:13.628475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:13.720710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:13.734796 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:13.740431 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:13.741756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fcf088e6-bc01-4b88-8464-ad0c9a241389 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.407852 Jul 21 05:44:13.742523 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 48/88] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:13 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:13.865376 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:13.874424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2f34338e-3178-4fe7-ab59-eb5214f8d9cc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.262696 Jul 21 05:44:13.875424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 41/89] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:13 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:14.616640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:14.617763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:14.625221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:14.625641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:14.626640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:14.627051 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:14.760493 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:14.761161 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:14.768819 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:14.769258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:14.770030 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:14.770475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:14.830017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:14.838187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8f88373d-c5f1-4431-9220-9e98e62b4ef0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.225344 Jul 21 05:44:14.840029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 49/90] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:14 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:14.891992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:14.892600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:14.899818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:14.900631 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:14.901877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:14.902602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:14.965922 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:14.975353 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:14.976865 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:14.977977 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9c73c851-b40c-44b2-a74c-9cb4a5b0f1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.221799 Jul 21 05:44:14.978567 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 42/91] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:14 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:15.089035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:15.100627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-465f470a-7c62-407a-bb01-b8891d8e294b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.212555 Jul 21 05:44:15.101242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 50/92] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:14 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:15.293433 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-6f3c92fb-ad0d-48ee-9312-006be9d2d770 req-956e045f-ce24-4de3-8d8d-87f19ac771da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d7a2a5-58ba-48ea-9f1c-d504463da032", "tag": "12f5050c-8dc5-4cfd-8048-163c07b6a19f"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:15.301622 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-6f3c92fb-ad0d-48ee-9312-006be9d2d770 req-956e045f-ce24-4de3-8d8d-87f19ac771da service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:15.302094 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-6f3c92fb-ad0d-48ee-9312-006be9d2d770 req-956e045f-ce24-4de3-8d8d-87f19ac771da service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:15.313154 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-6f3c92fb-ad0d-48ee-9312-006be9d2d770 req-956e045f-ce24-4de3-8d8d-87f19ac771da service nova] Creating event network-changed:12f5050c-8dc5-4cfd-8048-163c07b6a19f for instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 on hv-cinder-85044 Jul 21 05:44:15.318025 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-6f3c92fb-ad0d-48ee-9312-006be9d2d770 req-956e045f-ce24-4de3-8d8d-87f19ac771da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028236 Jul 21 05:44:15.318641 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 43/93] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:15.860142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:15.860751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:15.867240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:15.867507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:15.868270 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:15.868695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:15.994522 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=8 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:15.998716 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:15.999428 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:16.006084 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:16.006229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:16.006529 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:16.007303 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:16.007723 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:16.014216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-18a5deec-5780-493d-adf2-14536f0bf52c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.161834 Jul 21 05:44:16.020601 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 51/94] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:15 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:16.120710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:16.121345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:16.127478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:16.127935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:16.128687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:16.129120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:16.144200 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:16.152437 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:16.153951 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:16.155098 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a19b0a5e-9e10-42f5-abd3-88a71143bfc2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.161634 Jul 21 05:44:16.155855 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 44/95] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:15 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:16.418056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:16.430164 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0ea3cfca-da73-4e34-beac-05a608ed0089 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.314691 Jul 21 05:44:16.430693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 52/96] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:16 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:17.033684 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:17.034404 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:17.042133 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:17.042641 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:17.043643 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:17.044190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:17.174282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:17.174883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:17.176015 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:17.181248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:17.181730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:17.182481 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:17.182903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:17.183527 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ff2a2e82-ca98-48c0-a79b-b1e7e6376401 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.154992 Jul 21 05:44:17.184086 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 45/97] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:17 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:17.320861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:17.329715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:17.331260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:17.332355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-594ad1a7-e20f-42df-b3e8-15ce5448574b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.162190 Jul 21 05:44:17.332924 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 53/98] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:17 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:17.447117 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:17.447713 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:17.455390 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:17.455879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:17.456676 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:17.457273 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:17.774411 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:17.785831 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d6f056a5-7bcf-4d4c-8ea3-558c28025793 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.342697 Jul 21 05:44:17.797659 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 46/99] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:17 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:18.201313 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:18.202137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:18.210730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:18.215922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:18.217715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:18.218572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:18.220226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:18.353776 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:18.354373 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:18.370666 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:18.372057 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:18.373289 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:18.374074 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:18.566602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:18.579173 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b35fdb7a-3652-46bc-bed8-318cd9b5fce8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.378697 Jul 21 05:44:18.582025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 54/100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:18 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:18.714135 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:18.725103 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:18.731826 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:18.731826 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-896aa2cc-f55d-4d6f-addd-d7772d7cca4f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.378150 Jul 21 05:44:18.731826 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 47/101] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:18 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:18.804313 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:18.805178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:18.813739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:18.814513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:18.815363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:18.815991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:18.970914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:18.978563 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-19369458-6c4f-496e-8e4d-db6ba6131a31 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.180353 Jul 21 05:44:18.979328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 55/102] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:18 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:19.604963 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:19.606856 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:19.618987 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:19.619727 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:19.620887 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:19.621518 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:19.746184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:19.746880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:19.753113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:19.753642 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:19.754461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:19.754951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:19.854243 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:19.869665 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f3e4337c-4302-433a-95b9-16525a022481 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.269949 Jul 21 05:44:19.870455 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 48/103] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:19 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:19.934491 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:19.943874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:19.945395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:19.946755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6937b582-f6d8-4209-9810-4f78002a4ff0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.204824 Jul 21 05:44:19.947354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 56/104] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:19 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:19.995789 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:19.996556 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:20.003436 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:20.003881 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:20.004638 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:20.005130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:20.362528 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:20.370956 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-82ff0a31-5d77-4a4d-8eae-a7b3bf6a1a3f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.378983 Jul 21 05:44:20.371555 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 49/105] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:19 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:20.889590 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:20.890209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:20.896900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:20.897541 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:20.898644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:20.899256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:20.966921 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:20.967837 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:20.979035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:20.981804 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:20.982694 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:20.983259 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:21.364058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:21.371670 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-355a8187-babc-4c84-b7ef-ca261892a30b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.485928 Jul 21 05:44:21.376390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 57/106] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:20 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:21.391480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:21.392394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:21.403911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:21.404651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:21.405582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:21.406170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:21.467177 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:21.480854 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:21.483448 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:21.484928 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-1885af91-b98a-4131-8950-0804a0406bf7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.522977 Jul 21 05:44:21.497380 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 50/107] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:20 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:22.035881 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:22.048883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-52b83202-cf96-4094-8a21-4229c32ac6b5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.661200 Jul 21 05:44:22.052059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 58/108] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:21 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:22.392447 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:22.393192 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:22.400672 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:22.401116 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:22.402023 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:22.402451 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:22.504700 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:22.505733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:22.514420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:22.516679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:22.520916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:22.525090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:22.725830 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:22.737455 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-dd613921-b11e-4cdd-829f-f12c5bb55346 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.349013 Jul 21 05:44:22.740145 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:22.748983 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 51/109] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:22 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:22.750137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:22.751686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:22.753006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9f621d1b-5594-4d11-bdb0-d153ba148788 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.253162 Jul 21 05:44:22.753944 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 59/110] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:22 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:23.069215 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:23.069926 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:23.081071 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:23.081611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:23.082877 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:23.083841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:23.306208 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:23.317028 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-4a9e9753-5002-403c-9645-f942400fe8a8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.251631 Jul 21 05:44:23.318263 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 52/111] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:23 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:23.757609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:23.759420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:23.762494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:23.774633 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:23.775634 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:23.782902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:23.783660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:23.785256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:23.787113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:23.794605 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:23.800243 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:23.800949 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:23.802417 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:23.802614 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:24.032377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:24.041175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8f03cfc5-6b2d-4970-8d91-eb17533bd96c tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.289349 Jul 21 05:44:24.047182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 60/112] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:23 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:24.063972 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:24.069713 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=100 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:24.094095 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:24.096641 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:24.100629 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2297a415-38e9-4019-9498-b63fe9a03280 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.331894 Jul 21 05:44:24.101490 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 53/113] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:23 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:24.337645 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:24.338293 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:24.349163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:24.359218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:24.362654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:24.365176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:24.579200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:24.592110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5843bb1b-7034-4447-a6aa-e00c5f4a9925 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.258446 Jul 21 05:44:24.593967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 61/114] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:24 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:25.060347 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:25.061544 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:25.070467 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:25.077749 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:25.078807 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:25.079608 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:25.119202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:25.119861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:25.126547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:25.127225 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:25.128452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:25.129051 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:25.294201 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:25.306959 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-42ff531c-e398-4163-8cc8-1e412491ea5d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.250477 Jul 21 05:44:25.308724 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 54/115] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:25 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:25.323484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:25.333560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:25.335587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:25.336769 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-126deb2e-08f6-40e9-b719-cdec5cfba03c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.222089 Jul 21 05:44:25.350535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 62/116] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:25 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:25.610215 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:25.611105 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:25.619780 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:25.620623 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:25.621482 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:25.622404 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:25.812995 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:25.822993 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-32c252fe-dc0f-46b8-bd3b-2ece3831b490 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.215138 Jul 21 05:44:25.822993 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 55/117] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:25 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:26.331336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:26.335872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:26.347782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:26.349844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:26.353464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:26.356240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:26.361453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:26.362525 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:26.373196 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:26.373659 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:26.374493 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:26.375145 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:26.629092 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:26.641227 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:26.649059 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:26.654714 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b6415b33-a406-4628-875e-fc5379a95aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.300196 Jul 21 05:44:26.655605 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 56/118] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:26 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:26.701837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:26.711600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f7bed9b9-9e3c-4d88-a982-7f03ae6b0cdb tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.385678 Jul 21 05:44:26.714042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 63/119] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:26 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:26.840000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:26.840939 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:26.848195 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:26.848785 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:26.860699 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:26.861170 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:27.010399 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:27.018223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-0f8b2d8b-2d05-4c57-b021-0239a1c8048c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.183512 Jul 21 05:44:27.018983 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 57/120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:26 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:27.673654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:27.675135 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:27.685314 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:27.685817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:27.686628 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:27.687108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:27.731521 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:27.732254 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:27.744857 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:27.745305 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:27.747445 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:27.748138 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:27.981509 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:27.985347 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:27.994658 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-99ff1c33-8735-4686-b16c-f791bd21ff07 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.269076 Jul 21 05:44:27.995431 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:27.995706 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 58/121] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:27 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:27.997387 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:28.003805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-75568495-54a8-4446-af68-fe9807665c6c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.332083 Jul 21 05:44:28.015969 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 64/122] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:27 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:28.035716 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:28.036786 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:28.043159 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:28.044007 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:28.045216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:28.046544 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:28.237629 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:28.249354 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d8e27af3-f030-4caa-b882-81820dea7b16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.216840 Jul 21 05:44:28.250015 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 59/123] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:28 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:29.011384 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:29.012647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:29.022134 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:29.022968 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:29.023559 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:29.024354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:29.025456 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:29.026160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:29.029679 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:29.030136 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:29.030976 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:29.031598 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:29.434369 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:29.442714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-afb4bbb7-91a4-438c-8e1b-796b7fcf114b tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.435313 Jul 21 05:44:29.452073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 65/124] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:29 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:29.452073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:29.452652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:29.470346 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:29.470778 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:29.471589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:29.472021 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:29.494220 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:29.503565 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:29.505079 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:29.507370 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a56adfdc-c12b-4b41-86c9-7f13da5c21da tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.488253 Jul 21 05:44:29.508221 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 60/125] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:29 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:29.629989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:29.639475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-52982a03-3d1f-4563-a872-30952b83c368 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.190876 Jul 21 05:44:29.640364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 66/126] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:29 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:30.454117 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-573b5a6c-0a7b-4700-9022-c3588dcd6cbb req-6084631e-98c0-4cb6-afe3-f3b309a2d5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b4b556-e093-4708-85ec-1ae5cf887089", "name": "network-vif-plugged", "status": "completed", "tag": "6c81cf21-db6f-463e-b1ee-0c72d08f41ad"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:30.460014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:30.460613 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:30.470987 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-573b5a6c-0a7b-4700-9022-c3588dcd6cbb req-6084631e-98c0-4cb6-afe3-f3b309a2d5f6 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:30.471673 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-573b5a6c-0a7b-4700-9022-c3588dcd6cbb req-6084631e-98c0-4cb6-afe3-f3b309a2d5f6 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:30.475468 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:30.476149 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:30.477278 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:30.477913 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:30.483578 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-573b5a6c-0a7b-4700-9022-c3588dcd6cbb req-6084631e-98c0-4cb6-afe3-f3b309a2d5f6 service nova] Creating event network-vif-plugged:6c81cf21-db6f-463e-b1ee-0c72d08f41ad for instance 69b4b556-e093-4708-85ec-1ae5cf887089 on hv-cinder-85044 Jul 21 05:44:30.488794 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-573b5a6c-0a7b-4700-9022-c3588dcd6cbb req-6084631e-98c0-4cb6-afe3-f3b309a2d5f6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162166 Jul 21 05:44:30.493339 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 61/127] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:30.533491 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:30.535159 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:30.543314 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:30.543748 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:30.544531 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:30.544970 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:30.706330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:30.715284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-32c02795-335f-4dd0-9e86-fa4d284e5e48 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.259112 Jul 21 05:44:30.725676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 67/128] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:30 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:30.732735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:30.733299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:30.747073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:30.748022 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:30.749186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:30.750029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:30.750291 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:30.759214 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:30.760721 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:30.761825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-92fb80fc-16be-41e8-9c6a-7ab147485d4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.239652 Jul 21 05:44:30.767306 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 62/129] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:30 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:30.900926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:30.910746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7992815f-65d1-47fe-8207-b3987aa1fc16 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.185370 Jul 21 05:44:30.912115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 68/130] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:30 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:31.734182 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:31.734783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:31.742902 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:31.743485 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:31.744367 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:31.745144 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:31.780207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:31.780869 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:31.795223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:31.795223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:31.795223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:31.795697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:31.965876 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:31.973644 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-134a17f1-326a-4c42-aaae-ca87ac7b9028 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.244163 Jul 21 05:44:31.974202 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 63/131] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:31 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:31.978562 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:31.979145 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:31.985285 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:31.985717 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:31.986464 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:31.986891 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:31.996909 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:32.005821 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:32.007357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:32.008668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c1be0304-d497-4538-9365-cc74c20a8919 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.232552 Jul 21 05:44:32.009353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 69/132] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:31 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:32.125603 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:32.133458 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f91bf691-21a6-4376-80cb-c0559d45f198 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.158328 Jul 21 05:44:32.134042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 64/133] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:31 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:32.994712 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:32.995690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:33.003685 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:33.004119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:33.004875 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:33.005294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:33.027931 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:33.029076 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:33.036924 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:33.038803 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:33.038803 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:33.039123 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:33.194935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:33.203179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8f4c6950-3b5e-40b2-81f8-8ce29093eea2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.214425 Jul 21 05:44:33.203745 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 70/134] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:32 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:33.208364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:33.208961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:33.215075 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:33.215529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:33.216290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:33.216721 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:33.227540 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:33.235815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:33.237618 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:33.238707 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-62a24aed-3a73-434a-90de-0a847576875e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.214710 Jul 21 05:44:33.239285 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 65/135] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:33 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:33.349021 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:33.356596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6a48cbcd-d700-4c87-9f88-ed4d2194ee10 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.151733 Jul 21 05:44:33.357156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 71/136] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:33 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:34.219490 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:34.220118 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:34.226338 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:34.226767 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:34.227542 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:34.227965 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:34.264350 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:34.265006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:34.271785 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:34.272374 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:34.273278 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:34.273830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:34.413725 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:34.422667 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-cf9b9a6a-0cc8-4863-9d13-7745f1261010 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.207149 Jul 21 05:44:34.423259 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 66/137] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:34 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:34.427607 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:34.428189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:34.434082 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:34.434518 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:34.435299 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:34.435724 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:34.436438 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:34.445101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:34.446613 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:34.447710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-43484829-5f58-40cd-a8d2-6c2386bc562f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.187288 Jul 21 05:44:34.448457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 72/138] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:34 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:34.598479 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:34.610125 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-50c47596-7820-4bb4-98d4-bd231edbde77 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.185920 Jul 21 05:44:34.610701 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 67/139] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:34 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:35.441670 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:35.444284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:35.452473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:35.453431 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:35.454498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:35.454987 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:35.467355 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:35.467905 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:35.482272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:35.482723 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:35.483526 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:35.484000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:35.663860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:35.675574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d897beab-b538-4b9a-8ec1-874f6d9b43e0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.239324 Jul 21 05:44:35.686436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 73/140] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:35 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:35.696157 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:35.697606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:35.706729 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:35.707891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:35.718611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:35.719152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:35.720016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:35.726654 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:35.728799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:35.729935 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e4887e40-e096-473a-b222-b5f5509e403e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.266856 Jul 21 05:44:35.730660 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 68/141] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:35 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:35.856211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:35.864268 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-223d085a-1ff6-476f-b7b5-150e8dcb5f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.176017 Jul 21 05:44:35.864850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 74/142] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:35 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:36.692464 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:36.693069 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:36.699851 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:36.700302 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:36.701057 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:36.701486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:36.748396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:36.749679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:36.760084 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:36.760998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:36.762207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:36.762897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:36.881834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:36.890588 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-dc6402c3-1eae-495b-ade9-76a9fd98bed0 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.201904 Jul 21 05:44:36.900731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 69/143] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:36 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:36.909469 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:36.909469 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:36.915665 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:36.916669 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:36.917692 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:36.918217 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:36.931880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:36.941260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:36.942904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:36.944102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-58bcd5d9-1a8c-41a6-9a9d-673bfd8ab607 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.199719 Jul 21 05:44:36.945069 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 75/144] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:36 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:37.070873 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:37.085249 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-19a82460-0b08-4250-b3e1-dcaf993c0cfe tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.181145 Jul 21 05:44:37.086794 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 70/145] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:36 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:37.374210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-6bd3386c-3952-47e1-a0b2-150fc30583f4 req-e1c06a4b-fefd-4f80-b69e-da18232c756f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456", "name": "network-vif-plugged", "status": "completed", "tag": "2202ada8-e4b3-4035-bfb8-6abb7d693047"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:37.386222 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-6bd3386c-3952-47e1-a0b2-150fc30583f4 req-e1c06a4b-fefd-4f80-b69e-da18232c756f service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:37.386662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-6bd3386c-3952-47e1-a0b2-150fc30583f4 req-e1c06a4b-fefd-4f80-b69e-da18232c756f service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:37.417751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-6bd3386c-3952-47e1-a0b2-150fc30583f4 req-e1c06a4b-fefd-4f80-b69e-da18232c756f service nova] Creating event network-vif-plugged:2202ada8-e4b3-4035-bfb8-6abb7d693047 for instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 on hv-cinder-85044 Jul 21 05:44:37.428273 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-6bd3386c-3952-47e1-a0b2-150fc30583f4 req-e1c06a4b-fefd-4f80-b69e-da18232c756f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058646 Jul 21 05:44:37.429556 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 76/146] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:37.910151 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:37.910740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:37.931230 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:37.932595 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:37.942678 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:37.943229 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:37.949169 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=100 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:37.963915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:37.965179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:37.972752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:37.973434 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:37.974405 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:37.975267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:37.995788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:38.310216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:38.327443 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-be1e5640-a11c-4449-8647-2a61a8779c53 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.422703 Jul 21 05:44:38.328709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 71/147] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:37 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:38.336388 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:38.337238 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:38.341530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:38.344559 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=76 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:38.348641 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:38.349393 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:38.350514 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:38.351375 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:38.353145 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:38.355542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:38.356873 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f4d910ba-ee1b-48ee-9d45-63dc34b10ead tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.397469 Jul 21 05:44:38.360809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 77/148] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:37 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:38.581708 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:38.589877 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e389d020-54c8-487e-ad00-ccc6db7aafed tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.259452 Jul 21 05:44:38.590600 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 72/149] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:38 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:39.345257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:39.345874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:39.353475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:39.353898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:39.354896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:39.355651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:39.384219 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:39.391996 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:39.408457 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:39.409200 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:39.410505 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:39.411258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:39.612259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:39.631035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-33304c34-7140-42fa-a039-450940de2593 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1315 microversion: 2.1 time: 0.289955 Jul 21 05:44:39.642040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 78/150] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:39 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:39.642284 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:39.654982 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:39.655982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-b3277617-d38d-44f7-aea3-15cb0d16a58e req-aaee2b7d-cc54-40bd-9023-4b19a5f72e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c3106a-0a81-4575-b1a7-dc0fc54551e2", "name": "network-vif-plugged", "status": "completed", "tag": "38bd4456-0aed-49a5-99eb-1bfcf154ecc0"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:39.664629 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:39.668095 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-442e36e9-1a93-44b6-a14c-ce8b5c037af4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.296914 Jul 21 05:44:39.669328 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 73/151] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:39 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:39.678367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-b3277617-d38d-44f7-aea3-15cb0d16a58e req-aaee2b7d-cc54-40bd-9023-4b19a5f72e53 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:39.679237 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-b3277617-d38d-44f7-aea3-15cb0d16a58e req-aaee2b7d-cc54-40bd-9023-4b19a5f72e53 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:39.682844 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:39.691271 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:39.704732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:39.707165 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:39.710051 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:39.710908 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:39.714437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-b3277617-d38d-44f7-aea3-15cb0d16a58e req-aaee2b7d-cc54-40bd-9023-4b19a5f72e53 service nova] Creating event network-vif-plugged:38bd4456-0aed-49a5-99eb-1bfcf154ecc0 for instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 on hv-cinder-85044 Jul 21 05:44:39.726851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-b3277617-d38d-44f7-aea3-15cb0d16a58e req-aaee2b7d-cc54-40bd-9023-4b19a5f72e53 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082843 Jul 21 05:44:39.727490 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 79/152] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:39.885854 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:39.894736 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d50f6354-cad5-4978-b92d-32fc708fa26b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.219465 Jul 21 05:44:39.895376 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 74/153] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:39 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:40.650110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:40.650969 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:40.659408 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:40.664176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:40.665126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:40.666039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:40.696929 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:40.697578 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:40.704928 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:40.705374 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:40.706129 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:40.710575 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:40.981473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:40.997255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4c959d81-a45b-436e-b496-b16fd5ea3a1d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1501 microversion: 2.1 time: 0.352713 Jul 21 05:44:40.997853 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 80/154] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:40 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1501 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:41.008921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:41.010407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:41.013934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:41.029072 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:41.030944 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:41.043946 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-235c1d3e-7a63-46e5-a072-e705d76bf8fa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.342183 Jul 21 05:44:41.045028 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 75/155] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:40 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:41.058259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:41.058807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:41.060842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:41.061289 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:41.309213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:41.317537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-108b8a48-7166-4da6-87d5-74f88da04ed7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.318654 Jul 21 05:44:41.318116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 81/156] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:40 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:41.749566 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-f7632b91-cdb4-48b4-b549-74f1776e4252 req-49afd900-45ab-422d-9edd-61fbd58a0667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d7a2a5-58ba-48ea-9f1c-d504463da032", "name": "network-vif-plugged", "status": "completed", "tag": "12f5050c-8dc5-4cfd-8048-163c07b6a19f"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:41.774565 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-f7632b91-cdb4-48b4-b549-74f1776e4252 req-49afd900-45ab-422d-9edd-61fbd58a0667 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:41.775730 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-f7632b91-cdb4-48b4-b549-74f1776e4252 req-49afd900-45ab-422d-9edd-61fbd58a0667 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:41.818878 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-f7632b91-cdb4-48b4-b549-74f1776e4252 req-49afd900-45ab-422d-9edd-61fbd58a0667 service nova] Creating event network-vif-plugged:12f5050c-8dc5-4cfd-8048-163c07b6a19f for instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 on hv-cinder-85044 Jul 21 05:44:41.833308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-f7632b91-cdb4-48b4-b549-74f1776e4252 req-49afd900-45ab-422d-9edd-61fbd58a0667 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089487 Jul 21 05:44:41.835196 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 76/157] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:42.062251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:42.062954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:42.075101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:42.077497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:42.081638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:42.082102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:42.256302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:42.265513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:42.267768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:42.269902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bf6fdbc0-fb87-4975-9f30-d3d99ba57592 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.211221 Jul 21 05:44:42.270458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 82/158] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:42 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:42.334698 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:42.335420 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:42.343775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:42.344415 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:42.345287 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:42.345610 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:42.568833 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:42.578806 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-917ed1a4-3fbc-4f3c-827b-a9087a6da524 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.248100 Jul 21 05:44:42.579890 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 77/159] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:42 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:42.857107 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9170052c-abc6-4c8e-b953-610127e21fc7 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a72deed-ccc7-4d7c-aceb-1513ddd6e69d"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:42.858559 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9170052c-abc6-4c8e-b953-610127e21fc7 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:42.866966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9170052c-abc6-4c8e-b953-610127e21fc7 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:42.867437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9170052c-abc6-4c8e-b953-610127e21fc7 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:42.868214 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9170052c-abc6-4c8e-b953-610127e21fc7 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:42.868646 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9170052c-abc6-4c8e-b953-610127e21fc7 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:43.294773 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:43.294773 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:43.300781 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:43.301279 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:43.302039 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:43.302507 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:43.504933 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:43.520479 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:43.522848 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:43.525093 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-bf7a2eda-3b25-4245-96d6-a13814846c12 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1406 microversion: 2.20 time: 0.240354 Jul 21 05:44:43.526391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 78/160] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:43 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:44:43.596391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:43.597102 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:43.603192 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:43.603854 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:43.604885 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:43.605475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:43.766899 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:43.775237 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b985cd10-b4dd-4a1e-96a9-47a4e0ceb45b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.182654 Jul 21 05:44:43.775912 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 79/161] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:43 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:44.546326 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:44.550268 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:44.554338 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:44.554957 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:44.555969 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:44.556549 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:44.712388 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:44.722424 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:44.723978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:44.725113 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c203148b-c2af-4a49-8b2c-f610d1be9cce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1598 microversion: 2.20 time: 0.183104 Jul 21 05:44:44.725968 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 80/162] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:44:44 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1598 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:44:44.747186 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8214c442-4885-4ac7-b25d-7d5dc6764aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:44.747764 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8214c442-4885-4ac7-b25d-7d5dc6764aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:44.754789 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8214c442-4885-4ac7-b25d-7d5dc6764aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:44.755252 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8214c442-4885-4ac7-b25d-7d5dc6764aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:44.756319 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8214c442-4885-4ac7-b25d-7d5dc6764aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:44.757283 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8214c442-4885-4ac7-b25d-7d5dc6764aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:44.921666 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8214c442-4885-4ac7-b25d-7d5dc6764aba tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180239 Jul 21 05:44:44.924183 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 81/163] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jul 21 05:44:44 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:44:44.930906 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:44.931879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:44.940137 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:44.941183 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:44.942522 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:44.943191 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:45.469412 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:45.481089 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-284d6fc9-38fd-41b1-807f-f48d47c2671f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.555094 Jul 21 05:44:45.482769 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 82/164] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:44 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:46.499084 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:46.499678 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:46.506377 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:46.506817 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:46.508031 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:46.508462 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:46.722991 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:46.732606 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5fd37a55-6470-4199-a516-0fb62da12e39 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.237234 Jul 21 05:44:46.733914 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 83/165] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:46 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:46.750825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-115c1df2-c018-4e0a-89b0-3a75c7df88f1 req-34423508-daf2-4407-9466-3cfe5aa56251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82c3106a-0a81-4575-b1a7-dc0fc54551e2", "tag": "38bd4456-0aed-49a5-99eb-1bfcf154ecc0"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:46.761042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-115c1df2-c018-4e0a-89b0-3a75c7df88f1 req-34423508-daf2-4407-9466-3cfe5aa56251 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:46.761834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-115c1df2-c018-4e0a-89b0-3a75c7df88f1 req-34423508-daf2-4407-9466-3cfe5aa56251 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:46.778201 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-115c1df2-c018-4e0a-89b0-3a75c7df88f1 req-34423508-daf2-4407-9466-3cfe5aa56251 service nova] Creating event network-changed:38bd4456-0aed-49a5-99eb-1bfcf154ecc0 for instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 on hv-cinder-85044 Jul 21 05:44:46.791586 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-115c1df2-c018-4e0a-89b0-3a75c7df88f1 req-34423508-daf2-4407-9466-3cfe5aa56251 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055953 Jul 21 05:44:46.792703 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 84/166] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:47.753665 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:47.754390 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:47.763346 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:47.764052 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:47.768637 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:47.769237 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:47.952316 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:47.961415 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-62d9df98-85ae-4e59-b618-b4c8b8a621b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.212307 Jul 21 05:44:47.964477 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 85/167] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:47 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:48.981225 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:48.982775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:49.001172 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:49.003216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:49.007135 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:49.007862 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:49.269309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:49.285201 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-27ea37f1-bdbf-4440-a8be-6e40cfeeabec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.307569 Jul 21 05:44:49.285841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 86/168] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:48 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:50.306532 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:50.307611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:50.318440 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:50.319232 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:50.320808 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:50.321515 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:50.469338 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:50.476799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9ac19ad7-c7cf-499f-a15d-ba0cec7a9ed0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.176708 Jul 21 05:44:50.477348 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 87/169] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:50 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:51.493621 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:51.494228 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:51.500924 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:51.501359 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:51.502111 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:51.502537 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:51.635332 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:51.642966 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a8523859-c40b-4dd2-987c-05100cedd83a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.153146 Jul 21 05:44:51.643551 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 88/170] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:51 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:52.662582 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:52.663355 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:52.670778 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:52.671337 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:52.672225 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:52.672728 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:52.693134 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=100 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:52.808886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:52.816991 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-3fcf0b12-ca97-40b7-bbeb-53ef528248ec tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1321 microversion: 2.1 time: 0.159406 Jul 21 05:44:52.817562 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 89/171] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:52 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:52.867222 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=59 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:53.009845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=34 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:44:53.834468 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:53.836254 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:53.851381 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:53.851878 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:53.852761 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:53.853194 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:53.994233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9170052c-abc6-4c8e-b953-610127e21fc7 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "POST /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.140865 Jul 21 05:44:53.995627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 83/172] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 05:44:42 2022] POST /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089/os-volume_attachments => generated 194 bytes in 11143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:44:54.013781 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:54.027968 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b8c02881-3765-4328-b07d-58eb71da144e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1514 microversion: 2.1 time: 0.198001 Jul 21 05:44:54.028555 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 90/173] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:53 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:44:54.048522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:44:54.050249 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:54.057123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:54.057819 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:54.059700 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:54.060411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:54.085520 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lazy-loading 'flavor' on Instance uuid 52d7a2a5-58ba-48ea-9f1c-d504463da032 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:44:54.201050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ab0d5886-9241-4b3b-9cdb-3803ef56b65a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032/action" status: 200 len: 32 microversion: 2.1 time: 0.158610 Jul 21 05:44:54.201720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 84/174] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:44:54 2022] POST /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 05:44:54.210783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:54.211419 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:54.217934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:54.218421 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:54.219386 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:54.220031 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:54.353898 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:54.362053 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9ffa27eb-8c67-46d9-9f56-3cf0a5793fc1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.155042 Jul 21 05:44:54.362752 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 91/175] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:54 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:55.380850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:55.381892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:55.392548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:55.393480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:55.394500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:55.395233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:55.579975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:55.595884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5998de3b-e235-4179-ac54-4535c859e2d8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.220177 Jul 21 05:44:55.596596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 85/176] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:55 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:56.613693 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:56.614336 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:56.621827 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:56.622279 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:56.623043 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:56.623532 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:56.764223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:56.772078 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-fc276343-0c55-4990-aa8e-cbb975d1f1ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.162380 Jul 21 05:44:56.772652 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 92/177] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:56 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:57.790340 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:57.791453 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:57.798501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:57.798877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:57.799690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:57.800147 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:57.951033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:57.959194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-218691dd-d093-4877-8d41-cf04bd2fbddd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.173828 Jul 21 05:44:57.959541 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 86/178] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:57 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:44:58.976082 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:44:58.976695 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:44:58.982807 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:58.983289 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:58.984051 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:44:58.984491 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:44:59.135661 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:44:59.144802 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a27c724d-4a04-4d89-b1a5-8b0c5069789c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.172535 Jul 21 05:44:59.145614 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 93/179] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:44:58 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:00.165242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:00.166271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:00.173327 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:00.174058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:00.175125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:00.175617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:00.319402 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:00.327599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0e4810bd-8c7e-46e7-a12a-2bb831578492 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.166308 Jul 21 05:45:00.337359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 87/180] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:00 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:01.344537 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:01.345789 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:01.352230 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:01.352680 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:01.353450 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:01.353919 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:01.492121 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:01.499916 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c059c024-3330-4f0f-a871-6dc7bea0ab97 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.159446 Jul 21 05:45:01.500572 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 94/181] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:01 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:02.516834 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:02.517527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:02.524835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:02.525290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:02.527302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:02.527939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:02.680175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:02.688125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-69cb7285-60d3-4481-915a-8be460dfa4cf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.175287 Jul 21 05:45:02.688719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 88/182] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:02 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:03.705740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:03.706543 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:03.713163 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:03.713639 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:03.714574 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:03.715189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:03.865170 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:03.874413 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d5003572-56bc-489c-931e-04875d0e09ff tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.172544 Jul 21 05:45:03.874914 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 95/183] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:03 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:04.891492 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:04.892096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:04.898782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:04.899255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:04.900042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:04.900473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:05.045550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:05.053646 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1f6e693a-674a-4753-b921-ee98f9f64bb7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.166209 Jul 21 05:45:05.054209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 89/184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:04 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:05.328224 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:05.328710 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:05.334688 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:05.335179 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:05.343495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:05.343495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:05.364778 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Going to try to terminate instance {{(pid=124329) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:45:05.459202 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-6fe12375-6559-4482-827f-e9aed3d58789 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "DELETE /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 204 len: 0 microversion: 2.1 time: 0.134569 Jul 21 05:45:05.459788 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 96/185] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:45:05 2022] DELETE /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:45:05.468637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:05.469235 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:05.476765 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:05.477280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:05.478068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:05.478515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:05.614664 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:05.622887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fc59e9b5-0007-42c2-af65-b81933fced3d tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1553 microversion: 2.1 time: 0.158194 Jul 21 05:45:05.623494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 90/186] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:05 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:06.071558 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:06.072343 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:06.078937 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:06.079620 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:06.080470 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:06.081083 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:06.222824 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:06.230563 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-47607a83-5446-4072-b068-b9250e65bef6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.163265 Jul 21 05:45:06.231140 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 97/187] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:06 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:06.641312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:06.641952 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:06.650283 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:06.650847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:06.652112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:06.652594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:06.792709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:06.801059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b02fb693-6aec-403a-b9ef-a0f208a48773 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1553 microversion: 2.1 time: 0.164387 Jul 21 05:45:06.801612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 91/188] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:06 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:07.248021 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:07.248715 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:07.255037 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:07.255475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:07.256222 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:07.256638 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:07.387334 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:07.395223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-66abe68f-9326-4edb-8921-7d8efa15957d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.151523 Jul 21 05:45:07.395790 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 98/189] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:07 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:07.818688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:07.819339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:07.826025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:07.826467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:07.827344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:07.827853 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:07.965106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:07.973167 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7c625d17-a8d7-4099-b33d-e16322f3dbf6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1553 microversion: 2.1 time: 0.158541 Jul 21 05:45:07.973916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 92/190] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:07 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:08.413907 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:08.415528 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:08.417831 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:08.425258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:08.425700 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:08.426746 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:08.427479 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:08.752696 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:08.760583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c316f335-0326-497c-a43f-5bc907f092db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.351694 Jul 21 05:45:08.761122 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 99/191] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:08 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:08.990603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:08.991281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:09.005306 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:09.005801 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:09.006634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:09.007584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:09.091040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:09.100002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a0470239-9b2a-4827-ac06-255949291247 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1511 microversion: 2.1 time: 0.113192 Jul 21 05:45:09.103946 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-9740d1f1-c915-460c-96fc-7829d5d8a9da req-b0a3758a-7d8d-47bd-8cb0-fe36887acc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69b4b556-e093-4708-85ec-1ae5cf887089", "name": "network-vif-deleted", "tag": "6c81cf21-db6f-463e-b1ee-0c72d08f41ad"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:45:09.104396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 93/192] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:08 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1511 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:09.119755 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-9740d1f1-c915-460c-96fc-7829d5d8a9da req-b0a3758a-7d8d-47bd-8cb0-fe36887acc12 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:09.121077 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-9740d1f1-c915-460c-96fc-7829d5d8a9da req-b0a3758a-7d8d-47bd-8cb0-fe36887acc12 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:09.134125 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-9740d1f1-c915-460c-96fc-7829d5d8a9da req-b0a3758a-7d8d-47bd-8cb0-fe36887acc12 service nova] Creating event network-vif-deleted:6c81cf21-db6f-463e-b1ee-0c72d08f41ad for instance 69b4b556-e093-4708-85ec-1ae5cf887089 on hv-cinder-85044 Jul 21 05:45:09.139742 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-9740d1f1-c915-460c-96fc-7829d5d8a9da req-b0a3758a-7d8d-47bd-8cb0-fe36887acc12 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039251 Jul 21 05:45:09.140752 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 100/193] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:45:09.778004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:09.778657 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:09.785121 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:09.785561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:09.786310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:09.786738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:09.921469 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:09.930021 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5ebaa420-323e-4db2-a9bc-3e458e019f30 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.156229 Jul 21 05:45:09.930642 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 94/194] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:09 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:10.125289 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:10.126263 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:10.133274 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:10.133718 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:10.134472 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:10.134904 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:10.201815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f138c8f0d4940af6737d2576a7326', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a36ae0fd7b648158ce3fbe24d474ad7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:10.210594 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d7d41a46-42c9-40d4-8b99-52027a2da0a6 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 200 len: 1346 microversion: 2.1 time: 0.091420 Jul 21 05:45:10.211190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 101/195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:10 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 1346 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:10.948470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:10.949081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:10.957964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:10.958406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:10.959285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:10.959713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:11.131884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:11.141481 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9cdf3489-0fa5-452a-9927-c6504709dbc2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.198433 Jul 21 05:45:11.151911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 95/196] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:10 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:11.228426 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:11.230098 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:11.238728 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:11.239316 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:11.239951 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:11.240515 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:11.254751 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.wsgi [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] HTTP exception thrown: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Request method failure captured: Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 HTTP/1.1 Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 0 Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeTNEalxWnpDnxx54oxD4-KhhlnPZk82WhDzbbiZQe3t59gzeS76p_vuC1UrSFv5xjP4OCFuzuyYTIa3s_PKzSFvjXo6TPzeooCzATjkNiszmXAldEQAXQ9AHQjUbbKqwymnnmCeqpOMelVIEHB_ZEt2qDwJpiQ8Jf3od2026UiHg0 Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:45:11.259364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5a36ae0fd7b648158ce3fbe24d474ad7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}] Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: d01f138c8f0d4940af6737d2576a7326 Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: > Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.261035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'id': '69b4b556-e093-4708-85ec-1ae5cf887089'} Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:45:11.261758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.263032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.266239 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Returning 404 to user: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:45:11.267632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5c1461ef-4ccb-402f-b35a-d4bf90d55c32 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 404 len: 111 microversion: 2.1 time: 0.043754 Jul 21 05:45:11.268687 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 102/197] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:11 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:45:11.412934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:11.414105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:11.420850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:11.422077 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:11.423179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:11.423793 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:11.439262 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] HTTP exception thrown: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Request method failure captured: Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089/os-volume_attachments HTTP/1.1 Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeTNEalxWnpDnxx54oxD4-KhhlnPZk82WhDzbbiZQe3t59gzeS76p_vuC1UrSFv5xjP4OCFuzuyYTIa3s_PKzSFvjXo6TPzeooCzATjkNiszmXAldEQAXQ9AHQjUbbKqwymnnmCeqpOMelVIEHB_ZEt2qDwJpiQ8Jf3od2026UiHg0 Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:45:11.445280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5a36ae0fd7b648158ce3fbe24d474ad7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}] Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: d01f138c8f0d4940af6737d2576a7326 Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.446715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'server_id': '69b4b556-e093-4708-85ec-1ae5cf887089'} Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:45:11.447574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:11.449212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:11.450666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Returning 404 to user: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:45:11.450666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-31b5054a-128f-4d24-b73c-4f15163efdf8 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038159 Jul 21 05:45:11.450666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 96/198] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 05:45:11 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:45:12.163708 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:12.164390 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:12.171807 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:12.172343 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:12.173498 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:12.173971 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:12.307503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:12.315369 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e063fb91-d432-4c9d-85f2-8f8ea8f0582f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.157905 Jul 21 05:45:12.315946 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 103/199] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:12 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:13.333452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:13.334000 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:13.340580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:13.341026 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:13.341815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:13.342232 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:13.479005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:13.482586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:13.487510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3d224e4a-764c-44af-a6a6-1f377a2f7bce tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.158379 Jul 21 05:45:13.488082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 97/200] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:13 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:14.508959 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:14.509965 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:14.521473 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:14.522325 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:14.523771 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:14.524652 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:14.669630 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:14.677709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ace60c46-2f1f-4d13-b0d5-5c229a9193eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.175416 Jul 21 05:45:14.679069 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 104/201] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:14 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:14.774077 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:14.774652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:14.782470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:14.783002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:14.783887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:14.784325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:14.800582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] HTTP exception thrown: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Request method failure captured: Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 HTTP/1.1 Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeTNEalxWnpDnxx54oxD4-KhhlnPZk82WhDzbbiZQe3t59gzeS76p_vuC1UrSFv5xjP4OCFuzuyYTIa3s_PKzSFvjXo6TPzeooCzATjkNiszmXAldEQAXQ9AHQjUbbKqwymnnmCeqpOMelVIEHB_ZEt2qDwJpiQ8Jf3od2026UiHg0 Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:45:14.802749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5a36ae0fd7b648158ce3fbe24d474ad7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}] Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: d01f138c8f0d4940af6737d2576a7326 Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.804163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '69b4b556-e093-4708-85ec-1ae5cf887089'} Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:45:14.805102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.806608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.808246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Returning 404 to user: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:45:14.809357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-13036437-1c99-4bbd-9329-206435fca0e2 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "DELETE /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 404 len: 111 microversion: 2.1 time: 0.039133 Jul 21 05:45:14.810427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 98/202] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:45:14 2022] DELETE /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:45:14.818097 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:14.818998 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] [instance: 69b4b556-e093-4708-85ec-1ae5cf887089] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:14.825611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:14.826058 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:14.826848 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:14.827294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:14.841731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.wsgi [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] HTTP exception thrown: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Request method failure captured: Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 HTTP/1.1 Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 0 Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeTNEalxWnpDnxx54oxD4-KhhlnPZk82WhDzbbiZQe3t59gzeS76p_vuC1UrSFv5xjP4OCFuzuyYTIa3s_PKzSFvjXo6TPzeooCzATjkNiszmXAldEQAXQ9AHQjUbbKqwymnnmCeqpOMelVIEHB_ZEt2qDwJpiQ8Jf3od2026UiHg0 Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:45:14.843281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5a36ae0fd7b648158ce3fbe24d474ad7", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5a36ae0fd7b648158ce3fbe24d474ad7"}]}] Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: 5a36ae0fd7b648158ce3fbe24d474ad7 Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-DeleteServersTestJSON-2082209852 Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: d01f138c8f0d4940af6737d2576a7326 Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-DeleteServersTestJSON-2082209852-project Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: > Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.844758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'id': '69b4b556-e093-4708-85ec-1ae5cf887089'} Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:45:14.845552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. Jul 21 05:45:14.846952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:45:14.849319 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] Returning 404 to user: Instance 69b4b556-e093-4708-85ec-1ae5cf887089 could not be found. {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:45:14.849319 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9b19cf51-6c31-4cc2-869e-391c5891b582 tempest-DeleteServersTestJSON-2082209852 tempest-DeleteServersTestJSON-2082209852-project] 10.222.0.44 "GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089" status: 404 len: 111 microversion: 2.1 time: 0.030475 Jul 21 05:45:14.849319 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 105/203] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:14 2022] GET /compute/v2.1/servers/69b4b556-e093-4708-85ec-1ae5cf887089 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:45:15.695593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:15.696549 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:15.710913 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:15.711377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:15.712134 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:15.712584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:15.990902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:15.998591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b4b81abb-e31e-4a86-9b82-461f82b7807c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.306776 Jul 21 05:45:15.999172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 99/204] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:15 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:17.016464 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:17.017833 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:17.035674 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:17.036513 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:17.037587 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:17.038242 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:17.063586 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:17.188231 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:17.196438 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-0d7b2fa7-41dd-4cfe-9bd4-ca9fb5c20dbf tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.184253 Jul 21 05:45:17.206004 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 106/205] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:17 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:18.213535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:18.214215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:18.221033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:18.221618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:18.222622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:18.223071 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:18.414559 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:18.422833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0c65a985-f826-4929-a489-21af4379bde7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.213584 Jul 21 05:45:18.432533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 100/206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:18 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:19.439485 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:19.440265 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:19.447626 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:19.448253 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:19.449220 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:19.449707 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:19.604308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:19.611475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8ea53b70-471e-41c4-8d04-0a4260353663 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.175677 Jul 21 05:45:19.612099 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 107/207] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:19 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:20.629335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:20.630041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:20.636955 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:20.637474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:20.638293 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:20.638742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:20.841036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:20.849332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e9656c6d-cb39-40fb-b9a3-94b0790ce3e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.224425 Jul 21 05:45:20.849899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 101/208] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:20 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:21.874835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:21.875620 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:21.882353 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:21.882849 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:21.883783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:21.884392 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:22.037493 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:22.045523 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a8b19120-aa3f-4c07-97c4-a86833c446e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.183156 Jul 21 05:45:22.046190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 108/209] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:21 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:23.062958 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:23.063599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:23.066178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=37 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:23.071704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:23.072144 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:23.072887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:23.073312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:23.207494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:23.215054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-93180338-1787-483b-8dac-868523f88e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.155973 Jul 21 05:45:23.215811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 102/210] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:23 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:24.232618 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:24.233343 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:24.239572 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:24.240010 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:24.240762 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:24.241178 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:24.604433 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:24.612080 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-87863b7a-7c1d-42ea-8d02-d287afad46e0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.383270 Jul 21 05:45:24.612644 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 109/211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:24 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:25.630723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:25.631611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:25.638605 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:25.639494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:25.640436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:25.641008 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:25.871345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:25.883150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-21e1f040-916f-48dd-ae1b-81ef734feb7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.256498 Jul 21 05:45:25.886756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 103/212] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:25 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:26.904868 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:26.906732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:26.913884 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:26.914506 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:26.915476 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:26.916078 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:27.093474 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:27.105678 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-da961a56-a895-4dad-acaf-bb398f64d35e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.206288 Jul 21 05:45:27.106600 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 110/213] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:26 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:28.124345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:28.126457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:28.133652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:28.134880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:28.135841 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:28.136472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:28.286112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:28.293986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7322b0ef-4b44-4841-9868-8183f895160b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1520 microversion: 2.1 time: 0.174241 Jul 21 05:45:28.294894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 104/214] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:28 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:29.313262 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:29.313984 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:29.324978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:29.327047 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:29.328988 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:29.329866 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:29.486636 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:29.495323 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-40c9f68f-f6ea-4957-a358-58efcc5da0f3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1500 microversion: 2.1 time: 0.186757 Jul 21 05:45:29.495978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 111/215] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:29 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1500 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:29.513035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:29.513569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:29.521280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:29.521730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:29.522643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:29.522948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:29.677684 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:29.688270 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-557abd80-62e3-4bec-ac78-76ec73a54a8e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1514 microversion: 2.1 time: 0.179158 Jul 21 05:45:29.688850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 105/216] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:29 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:36.340073 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:45:36.341048 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:36.347397 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:36.347873 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:36.348630 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:36.349062 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:36.372515 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.objects.instance [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lazy-loading 'flavor' on Instance uuid 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 {{(pid=124329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:45:36.485242 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f851a09c-e010-430c-a6de-9f5ff57ca62a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456/action" status: 200 len: 32 microversion: 2.1 time: 0.148995 Jul 21 05:45:36.485765 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 112/217] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:45:36 2022] POST /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 05:45:36.495140 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:36.495706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:36.503342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:36.503886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:36.504729 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:36.505224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:36.649616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:36.657301 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d3006fa1-97c3-4329-9315-d48cbceedaca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.165973 Jul 21 05:45:36.657837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 106/218] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:36 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:45:37.675951 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:37.676644 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:37.684261 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:37.684697 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:37.685448 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:37.685876 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:37.815524 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:37.823105 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-1f60257f-6892-4403-a76f-c3cbb1449883 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.151595 Jul 21 05:45:37.823655 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 113/219] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:37 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:38.839691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:38.840285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:38.847381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:38.847820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:38.848570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:38.848993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:38.986652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:38.994841 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-009d6325-0391-45c1-8c63-c71be7dc96e1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.158961 Jul 21 05:45:38.995460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 107/220] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:38 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:40.016819 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:40.017765 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:40.021123 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=30 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:40.030304 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:40.031096 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:40.032331 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:40.033034 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:40.246482 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:40.255304 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ef740bfd-a5e5-4460-9f44-83ae79106448 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.244868 Jul 21 05:45:40.256166 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 114/221] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:40 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:41.277689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:41.278748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:41.287849 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:41.288300 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:41.289061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:41.289498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:41.420515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:41.428630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2d625cf9-fd18-4a82-b227-c569743dbd5c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.157514 Jul 21 05:45:41.429123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 108/222] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:41 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:42.450012 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:42.450996 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:42.459054 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:42.459497 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:42.460257 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:42.460687 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:42.597454 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:42.609046 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-987ac6de-f7d6-4a38-b010-ef1beeaf292f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.165166 Jul 21 05:45:42.609822 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 115/223] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:42 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:43.625756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:43.626469 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:43.632750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:43.633198 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:43.633935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:43.634356 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:43.761694 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:43.769329 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-91a77089-3702-4b0a-a09a-cf3b4cd8951e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.147462 Jul 21 05:45:43.769824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 109/224] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:43 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:44.791761 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:44.792355 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:44.798758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:44.799240 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:44.800099 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:44.800523 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:44.933475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:44.946527 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e9426fd2-d375-4cd0-b5cd-73ba0f724e7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.158307 Jul 21 05:45:44.948339 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 116/225] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:44 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:45.965540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:45.966154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:45.972979 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:45.973425 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:45.974188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:45.974618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:45.977194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=69 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:46.117781 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:46.125370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1942c9c5-a7d6-4ecc-9b2d-ddc724a526cd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.164827 Jul 21 05:45:46.125930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 110/226] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:45 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:47.145568 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:47.146148 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:47.152712 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:47.153183 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:47.153929 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:47.154354 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:47.156960 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:47.292664 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:47.301356 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2445e78b-0229-4ce6-b5b0-4705847e9e24 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.161488 Jul 21 05:45:47.301981 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 117/227] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:47 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:48.319409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:48.320012 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:48.326994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:48.327476 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:48.328248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:48.328657 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:48.469810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:48.480645 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f2fcaced-0330-45df-9aba-816017a96a15 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.165509 Jul 21 05:45:48.481216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 111/228] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:48 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:49.503609 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:49.504178 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:49.510523 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:49.510935 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:49.511738 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:49.512157 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:49.650237 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:49.658319 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-413f7057-0487-4ec3-8828-5f4ebd1f7722 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.160886 Jul 21 05:45:49.658874 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 118/229] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:49 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:50.678323 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:50.678850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:50.686126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:50.686568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:50.687362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:50.687778 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:50.824247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:50.834290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-01a859a4-9507-41ee-9fb5-2b30f4342704 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.160603 Jul 21 05:45:50.834856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 112/230] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:50 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:51.855837 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:51.856677 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:51.867382 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:51.868116 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:51.869375 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:51.870085 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:52.014153 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:52.024305 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-4c431731-7e13-4284-95e6-5eaa578bbeb8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.175193 Jul 21 05:45:52.024880 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 119/231] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:51 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:53.045829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:53.046895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:53.055416 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:53.055784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:53.056533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:53.056953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:53.187395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:53.195163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c73a37ef-c8ec-436b-8c32-b241a854a728 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.155833 Jul 21 05:45:53.195719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 113/232] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:53 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:54.212754 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:54.213325 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:54.220317 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:54.220767 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:54.221531 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:54.221964 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:54.357718 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:54.367246 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ab46487b-7cd4-4789-bd33-60c8f09f9294 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.158695 Jul 21 05:45:54.367852 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 120/233] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:54 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:55.387563 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:55.388450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:55.392165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=24 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:45:55.398643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:55.399118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:55.399880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:55.400310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:55.535166 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:55.543399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-014c47b0-ecb8-497b-bea3-cae646c52b0f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.162201 Jul 21 05:45:55.543976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 114/234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:55 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:56.567109 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:56.567770 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:56.576159 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:56.576741 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:56.577744 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:56.578311 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:56.715727 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:56.723624 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-867e7d5a-1dd3-468d-983d-89e895abf131 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.161954 Jul 21 05:45:56.724196 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 121/235] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:56 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:57.744836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:57.745821 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:57.755926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:57.756355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:57.757117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:57.757545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:57.894568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:57.906647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5a5d8eb9-c427-43af-9c5c-6886553a0e70 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.168007 Jul 21 05:45:57.907876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 115/236] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:57 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:45:58.929501 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:45:58.930348 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:45:58.940588 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:58.941320 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:58.942613 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:45:58.943380 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:45:59.083855 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:45:59.091640 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-19dca7e5-2e77-4505-bf18-118eb549b73f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.168833 Jul 21 05:45:59.092208 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 122/237] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:45:58 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:00.108821 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:00.109417 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:00.116350 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:00.116786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:00.117547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:00.117973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:00.248589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:00.261852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-daa2bb9b-3dd2-4bb1-a45d-6297a46c47db tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.151604 Jul 21 05:46:00.261852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 116/238] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:00 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:01.274484 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:01.276659 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:01.283052 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:01.283528 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:01.284829 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:01.285508 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:01.422879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:01.430707 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8be4f123-4b3f-459a-a7be-10133606ac79 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.161015 Jul 21 05:46:01.431305 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 123/239] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:01 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:02.447440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:02.448238 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:02.454725 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.455377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:02.456131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.456553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:02.592161 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:02.600118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-46542aa4-226c-4dc9-ba0a-07f2ddd35e29 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1500 microversion: 2.1 time: 0.156466 Jul 21 05:46:02.600799 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 117/240] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:02 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:02.617592 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03221d9d-e046-43cc-8040-fb6d9cf26c79"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:02.618790 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:02.624998 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.625428 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:02.626208 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.626620 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:02.651713 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.wsgi [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] HTTP exception thrown: Cannot 'attach_volume' instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 while it is in vm_state rescued Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Request method failure captured: Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: POST /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456/os-volume_attachments HTTP/1.1 Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 74 Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OeXMcQ0_o_qNTRQI8g9PtwmJ007UFL6IYF9l9vbUrWDLUgcQJj7mVw3W14vR_5GZz8pM4fJcbJQXqjv8M9QNmTuy-gyqIA6TliEbT8WOu-hYGhrVyV0uiuiBGzy0rlGCOM3VX9CJaKvzaECcKkijJBw5sEPTQ-J93NtHN4IM3JC0Gs Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:46:02.653414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_da2259120cca423686fd6e54d0ad2257", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}] Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: 563f1367093e493bae87a21374a3c2f3 Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {"volumeAttachment": {"volumeId": "03221d9d-e046-43cc-8040-fb6d9cf26c79"}} Jul 21 05:46:02.655130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: > Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Cannot 'attach_volume' instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 while it is in vm_state rescued Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'server_id': '1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456', 'body': {'volumeAttachment': {'volumeId': '03221d9d-e046-43cc-8040-fb6d9cf26c79'}}} Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:46:02.656090 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 while it is in vm_state rescued Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:46:02.657250 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:46:02.659206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:46:02.659206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:46:02.659206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 while it is in vm_state rescued Jul 21 05:46:02.659206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:46:02.659206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Returning 409 to user: Cannot 'attach_volume' instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 while it is in vm_state rescued {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:46:02.659206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-84f147ee-3b87-4350-aae1-84ebf21c2e60 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041468 Jul 21 05:46:02.659206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 124/241] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 05:46:02 2022] POST /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 21 05:46:02.665621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9b41c29c-296e-48c4-b001-12c682b9103b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:02.666832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9b41c29c-296e-48c4-b001-12c682b9103b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:02.676546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b41c29c-296e-48c4-b001-12c682b9103b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.677010 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b41c29c-296e-48c4-b001-12c682b9103b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:02.677932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b41c29c-296e-48c4-b001-12c682b9103b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.678467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b41c29c-296e-48c4-b001-12c682b9103b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:02.754509 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9b41c29c-296e-48c4-b001-12c682b9103b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456/action" status: 202 len: 0 microversion: 2.1 time: 0.092909 Jul 21 05:46:02.755164 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 118/242] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:46:02 2022] POST /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:46:02.764121 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:02.764892 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:02.771903 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.772344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:02.773108 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:02.773990 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:03.040480 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:03.048205 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ca1b2214-6c70-4d74-8b25-49ba40a81d0c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1508 microversion: 2.1 time: 0.288380 Jul 21 05:46:03.049478 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 125/243] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:02 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:04.066759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:04.067532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:04.074064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:04.074509 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:04.075332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:04.075770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:04.228914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:04.235391 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e85205be-428b-4508-8280-f66b63574185 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1508 microversion: 2.1 time: 0.173338 Jul 21 05:46:04.236494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 119/244] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:04 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:05.253156 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:05.253759 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:05.259820 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:05.260244 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:05.260980 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:05.261591 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:05.629447 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:05.637159 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-df210c49-8290-471c-820f-7047e2ea1b7f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1508 microversion: 2.1 time: 0.387879 Jul 21 05:46:05.637910 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 126/245] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:05 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1508 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:06.653874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:06.654506 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:06.661913 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:06.662636 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:06.663470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:06.663901 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:06.793897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:06.804967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ffad7c00-3b43-4773-b46b-7653a06ae0a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1508 microversion: 2.1 time: 0.154712 Jul 21 05:46:06.805709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 120/246] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:06 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:07.825638 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:07.826613 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:07.835481 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:07.835917 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:07.836671 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:07.837096 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:07.982751 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:07.990824 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-580b19b7-7df2-4e67-b330-91252424ef6d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1508 microversion: 2.1 time: 0.171606 Jul 21 05:46:07.991423 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 127/247] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:07 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:09.012756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:09.013698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:09.024733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:09.025524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:09.026755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:09.027530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:09.158921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:09.167199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-caa2a5e8-8304-41f4-9e5e-6bc772489b42 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1508 microversion: 2.1 time: 0.161380 Jul 21 05:46:09.167767 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 121/248] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:09 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:10.184953 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:10.185547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:10.187496 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=28 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:10.192598 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:10.193063 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:10.193811 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:10.194245 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:10.395874 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:10.404747 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-26e6b488-672c-4679-804e-a283229b45eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1514 microversion: 2.1 time: 0.223516 Jul 21 05:46:10.405328 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 128/249] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:10 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:11.962558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8c44667e-99be-40f9-b184-802d364c3f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'create', calling method: .version_select at 0x7f509054cca0>, body: {"keypair": {"name": "tempest-keypair-1264639962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeUQvnLPrnpq2mdMoWw3ijrXklEQ4PSAWkzhLHcwsCrtbVoJqVgAA2C/wm/aLXPicbXhxJgiUZT2RfqXSemXdQXZvxZnqPLoDGXD3bVErt5lcF/ZodkrbnfrPzQ0VpGPQ=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:11.994557 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-8c44667e-99be-40f9-b184-802d364c3f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for project da2259120cca423686fd6e54d0ad2257. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:46:11.999802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-8c44667e-99be-40f9-b184-802d364c3f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for user 563f1367093e493bae87a21374a3c2f3 and project da2259120cca423686fd6e54d0ad2257. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:46:12.068142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8c44667e-99be-40f9-b184-802d364c3f65 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109375 Jul 21 05:46:12.069727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 122/250] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 05:46:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:46:13.592490 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-163083646", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dcd68d6c-76ec-4044-ad63-fb25660c694c"}], "security_groups": [{"name": "tempest-securitygroup--258601200"}], "key_name": "tempest-keypair-1264639962", "user_data": "}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:13.726420 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.network.neutron [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] validate_networks() for [('dcd68d6c-76ec-4044-ad63-fb25660c694c', None, None, None, None, None)] {{(pid=124329) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:46:14.156258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Flavor limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:46:14.156716 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Image limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:46:14.157150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Flavor pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:46:14.157654 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Image pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:46:14.158038 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:46:14.168344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:14.168781 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:14.169559 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:14.170001 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:14.187431 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for project da2259120cca423686fd6e54d0ad2257. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:46:14.191890 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Getting quotas for user 563f1367093e493bae87a21374a3c2f3 and project da2259120cca423686fd6e54d0ad2257. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:46:14.204059 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Going to run 1 instances... {{(pid=124329) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:46:14.206410 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:46:14.260074 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a04c5a8a-9e58-4c6a-a9ae-9724628445c5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.673139 Jul 21 05:46:14.260726 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 129/251] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:46:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:46:14.271198 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-58e1be09-aa9d-4b3a-9195-15b695f576b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:14.271822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-58e1be09-aa9d-4b3a-9195-15b695f576b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:14.327298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-58e1be09-aa9d-4b3a-9195-15b695f576b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:14.334578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-58e1be09-aa9d-4b3a-9195-15b695f576b3 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1245 microversion: 2.1 time: 0.067488 Jul 21 05:46:14.335307 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 123/252] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:14 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:15.351883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:15.352476 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:15.365797 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:15.366415 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:15.367238 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:15.375223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:15.467530 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:15.484987 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-93d42bf2-1de8-437e-bdc0-bb4438f6d325 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1305 microversion: 2.1 time: 0.136189 Jul 21 05:46:15.485645 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 130/253] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:15 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1305 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:16.502131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:16.502738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:16.509576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:16.510013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:16.510773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:16.511256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:16.516568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:16.732070 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:16.740044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b7d57681-81e6-4e5a-a96b-98a4d8468a8d tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.241962 Jul 21 05:46:16.740715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 124/254] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:16 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:17.103703 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-f3b2f67b-497c-42d9-ab42-929e55712752 req-66a27681-6c55-4bce-ad52-0f855a0d7294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66ebf62-cfee-40f4-a957-c099e662d2b4", "tag": "99521012-321d-4cf5-8d32-bf5aa75214ed"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:17.116148 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-f3b2f67b-497c-42d9-ab42-929e55712752 req-66a27681-6c55-4bce-ad52-0f855a0d7294 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:17.117126 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-f3b2f67b-497c-42d9-ab42-929e55712752 req-66a27681-6c55-4bce-ad52-0f855a0d7294 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:17.130141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-f3b2f67b-497c-42d9-ab42-929e55712752 req-66a27681-6c55-4bce-ad52-0f855a0d7294 service nova] Creating event network-changed:99521012-321d-4cf5-8d32-bf5aa75214ed for instance c66ebf62-cfee-40f4-a957-c099e662d2b4 on hv-cinder-85044 Jul 21 05:46:17.135399 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-f3b2f67b-497c-42d9-ab42-929e55712752 req-66a27681-6c55-4bce-ad52-0f855a0d7294 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035983 Jul 21 05:46:17.136004 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 131/255] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:46:17.758857 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:17.759397 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:17.766424 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:17.766856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:17.767718 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:17.768192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:17.915227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:17.925316 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7aaf0322-ba01-41d4-b847-5faef58d0fc6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.171407 Jul 21 05:46:17.925886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 125/256] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:17 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:18.943103 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:18.943789 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:18.950832 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:18.951384 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:18.952150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:18.952576 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:18.956619 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=80 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:19.100142 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:19.113720 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c189c4d6-37bb-40d1-9044-6a40900e2a08 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.174776 Jul 21 05:46:19.114311 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 132/257] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:18 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:20.130917 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:20.132463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:20.139437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:20.139873 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:20.140625 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:20.141052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:20.378287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:20.386991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-19239aa7-8b13-4441-aad7-0a7d1fb0807b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.260015 Jul 21 05:46:20.389809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 126/258] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:20 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:21.407371 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:21.407966 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:21.414896 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:21.415504 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:21.416433 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:21.416946 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:21.607760 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:21.616990 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-457f5a6a-21e2-437f-b5fa-464b0b9fe134 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.214366 Jul 21 05:46:21.617563 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 133/259] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:21 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:21.907682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1012237481", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "networks": [{"uuid": "9c5da2f1-0c1d-481d-978e-bb853c4d8861"}]}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:21.960970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] validate_networks() for [('9c5da2f1-0c1d-481d-978e-bb853c4d8861', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:46:22.329362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:46:22.329737 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:46:22.330408 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:46:22.330811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:46:22.331239 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:46:22.340366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:22.340798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:22.341584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:22.342014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:22.359132 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Getting quotas for project cb4a02ef918f418f9509f0698503f428. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:46:22.363527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Getting quotas for user 5baede5b70674737ad285b5831e11002 and project cb4a02ef918f418f9509f0698503f428. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:46:22.374743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:46:22.377057 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:46:22.425344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-29ba64e5-f151-4789-b229-b848fd4a589e tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521419 Jul 21 05:46:22.426255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 127/260] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:46:22.436308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9fe12ad5-58d4-445b-b975-1d97e46264ef tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:22.436834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-9fe12ad5-58d4-445b-b975-1d97e46264ef tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:22.491509 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9fe12ad5-58d4-445b-b975-1d97e46264ef tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:22.499348 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9fe12ad5-58d4-445b-b975-1d97e46264ef tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1219 microversion: 2.1 time: 0.066725 Jul 21 05:46:22.499973 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 134/261] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:22 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:46:22.634970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:22.635775 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:22.645672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:22.646388 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:22.647368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:22.648054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:22.852281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:22.860465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-69c660bc-e463-4bae-8869-b87f89f8c070 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.229778 Jul 21 05:46:22.861008 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 128/262] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:22 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:23.047394 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-5f4b9121-6ef2-4ec2-a87c-1ce7044cb4cc req-dcb25ca6-16fb-4ec4-a46c-4d84f9c11c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66ebf62-cfee-40f4-a957-c099e662d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "99521012-321d-4cf5-8d32-bf5aa75214ed"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:23.059655 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-5f4b9121-6ef2-4ec2-a87c-1ce7044cb4cc req-dcb25ca6-16fb-4ec4-a46c-4d84f9c11c8b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:23.060291 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-5f4b9121-6ef2-4ec2-a87c-1ce7044cb4cc req-dcb25ca6-16fb-4ec4-a46c-4d84f9c11c8b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:23.076806 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-5f4b9121-6ef2-4ec2-a87c-1ce7044cb4cc req-dcb25ca6-16fb-4ec4-a46c-4d84f9c11c8b service nova] Creating event network-vif-plugged:99521012-321d-4cf5-8d32-bf5aa75214ed for instance c66ebf62-cfee-40f4-a957-c099e662d2b4 on hv-cinder-85044 Jul 21 05:46:23.082873 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-5f4b9121-6ef2-4ec2-a87c-1ce7044cb4cc req-dcb25ca6-16fb-4ec4-a46c-4d84f9c11c8b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039052 Jul 21 05:46:23.084206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 135/263] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:46:23.516474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:23.517078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:23.524050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:23.524524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:23.525287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:23.525710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:23.594866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:23.602633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0532a9cb-263a-4fcf-8ece-94939b3c912f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1271 microversion: 2.1 time: 0.089865 Jul 21 05:46:23.603413 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 129/264] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:23 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:23.878202 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:23.878902 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:23.890028 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:23.890996 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:23.894921 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:23.895675 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:24.028066 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:24.036316 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9cd3df1b-45c1-4a29-b749-d6489a1714a5 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.162180 Jul 21 05:46:24.036884 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 136/265] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:23 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:24.622356 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:24.624715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:24.631918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:24.632435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:24.633368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:24.633940 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:24.703597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:24.711970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-89e4b467-5302-432e-9e1e-21e870b655ae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1289 microversion: 2.1 time: 0.096195 Jul 21 05:46:24.712556 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 130/266] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:24 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:25.052841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:25.053446 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:25.055562 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=2 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:25.061144 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:25.061598 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:25.062354 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:25.062783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:25.276474 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:25.286118 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e814c427-9d1c-4920-8f32-32a50a7544e6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1370 microversion: 2.1 time: 0.237094 Jul 21 05:46:25.295532 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 137/267] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:25 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:25.729022 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:25.729622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:25.731975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:25.737488 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:25.737932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:25.738694 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:25.739158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:25.888835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:25.897055 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e03d30ef-580b-48c6-b958-a363a4aba23c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.171865 Jul 21 05:46:25.897657 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 131/268] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:25 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:26.305741 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:26.306304 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:26.314868 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:26.315313 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:26.316302 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:26.316948 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:26.552495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:26.561225 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-9dd8468f-0921-4f95-97e5-33b7d9b8939f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1563 microversion: 2.1 time: 0.259623 Jul 21 05:46:26.563355 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 138/269] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:26 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:26.579480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9af3a63a-4550-45c9-973a-f847db58952b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:26.580076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9af3a63a-4550-45c9-973a-f847db58952b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:26.586709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9af3a63a-4550-45c9-973a-f847db58952b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:26.587306 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9af3a63a-4550-45c9-973a-f847db58952b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:26.588141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9af3a63a-4550-45c9-973a-f847db58952b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:26.588647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9af3a63a-4550-45c9-973a-f847db58952b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:26.709761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9af3a63a-4550-45c9-973a-f847db58952b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134046 Jul 21 05:46:26.711082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 132/270] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 05:46:26 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:46:26.817767 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-e8639260-dcc3-4b16-b0d5-c3e41da50bd4 req-86957d3f-406e-4136-880a-487e16bac706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67", "tag": "74166195-78e3-4c32-8683-e0e6e946df06"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:26.827321 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-e8639260-dcc3-4b16-b0d5-c3e41da50bd4 req-86957d3f-406e-4136-880a-487e16bac706 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:26.827984 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-e8639260-dcc3-4b16-b0d5-c3e41da50bd4 req-86957d3f-406e-4136-880a-487e16bac706 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:26.847264 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-e8639260-dcc3-4b16-b0d5-c3e41da50bd4 req-86957d3f-406e-4136-880a-487e16bac706 service nova] Creating event network-changed:74166195-78e3-4c32-8683-e0e6e946df06 for instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 on hv-cinder-85044 Jul 21 05:46:26.861299 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-e8639260-dcc3-4b16-b0d5-c3e41da50bd4 req-86957d3f-406e-4136-880a-487e16bac706 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048800 Jul 21 05:46:26.862852 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 139/271] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:46:26.915003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:26.916344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:26.926084 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:26.929630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:26.932968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:26.933662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:27.183636 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:27.196547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-690ea0a3-eeae-4c50-8ddc-225065e9d2c4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.286019 Jul 21 05:46:27.197747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 133/272] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:26 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:28.026657 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-0221560b-3fee-40c6-b50b-42ff2abe7b51 req-72e59fa0-2d72-4996-a2c7-43f5b724d80d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66ebf62-cfee-40f4-a957-c099e662d2b4", "tag": "99521012-321d-4cf5-8d32-bf5aa75214ed"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:28.035719 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-0221560b-3fee-40c6-b50b-42ff2abe7b51 req-72e59fa0-2d72-4996-a2c7-43f5b724d80d service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:28.036051 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-0221560b-3fee-40c6-b50b-42ff2abe7b51 req-72e59fa0-2d72-4996-a2c7-43f5b724d80d service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:28.051580 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-0221560b-3fee-40c6-b50b-42ff2abe7b51 req-72e59fa0-2d72-4996-a2c7-43f5b724d80d service nova] Creating event network-changed:99521012-321d-4cf5-8d32-bf5aa75214ed for instance c66ebf62-cfee-40f4-a957-c099e662d2b4 on hv-cinder-85044 Jul 21 05:46:28.056585 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-0221560b-3fee-40c6-b50b-42ff2abe7b51 req-72e59fa0-2d72-4996-a2c7-43f5b724d80d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034042 Jul 21 05:46:28.057191 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 140/273] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:46:28.215153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:28.216004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:28.222478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:28.222910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:28.223695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:28.224122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:28.371297 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:28.379246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d2e9cde5-fa1b-4b99-8d3f-817e664a5b7b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.170466 Jul 21 05:46:28.379813 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 134/274] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:28 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:29.399103 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:29.399675 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:29.408836 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:29.409812 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:29.411073 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:29.411629 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:29.543550 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:29.551336 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d697d14f-c8dd-437b-9237-da27c9048044 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.156677 Jul 21 05:46:29.551899 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 141/275] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:29 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:30.569360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:30.569998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:30.577066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:30.577514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:30.578280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:30.578709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:30.916837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:30.926551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-57c827ae-b6a0-4adc-92fc-e6edb436828b tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.362050 Jul 21 05:46:30.932621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 135/276] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:30 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:31.944367 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:31.944935 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:31.951841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:31.952365 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:31.953309 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:31.953793 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:32.098254 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:32.106262 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-3c9f1a1f-05db-4bdb-ad87-c8f5b240f585 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.166101 Jul 21 05:46:32.106797 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 142/277] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:31 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:33.122657 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:33.123368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:33.129623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:33.130295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=12 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:33.132054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:33.132484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:33.133419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:33.134026 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:33.289761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:33.303442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e212a15b-347f-491c-8865-7b8440a954a0 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.179633 Jul 21 05:46:33.303442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 136/278] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:33 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:33.307635 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-db878778-8caf-4cd3-9d1c-baee036e9f81 req-092a25ad-a208-4425-95a1-1fc2f2d485fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67", "name": "network-vif-plugged", "status": "completed", "tag": "74166195-78e3-4c32-8683-e0e6e946df06"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:46:33.313107 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=8 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:46:33.318144 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-db878778-8caf-4cd3-9d1c-baee036e9f81 req-092a25ad-a208-4425-95a1-1fc2f2d485fc service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:33.318694 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-db878778-8caf-4cd3-9d1c-baee036e9f81 req-092a25ad-a208-4425-95a1-1fc2f2d485fc service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:33.333688 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-db878778-8caf-4cd3-9d1c-baee036e9f81 req-092a25ad-a208-4425-95a1-1fc2f2d485fc service nova] Creating event network-vif-plugged:74166195-78e3-4c32-8683-e0e6e946df06 for instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 on hv-cinder-85044 Jul 21 05:46:33.339104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-db878778-8caf-4cd3-9d1c-baee036e9f81 req-092a25ad-a208-4425-95a1-1fc2f2d485fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035545 Jul 21 05:46:33.339979 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 143/279] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:46:34.317830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:34.319325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:34.326813 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:34.327374 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:34.328310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:34.328812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:34.472115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:34.480500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f27c64bf-8d70-4b2d-a36b-dd29f267558a tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.168375 Jul 21 05:46:34.481376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 137/280] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:34 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:35.498473 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:35.499210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:35.505774 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:35.506213 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:35.506973 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:35.507493 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:35.642711 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:35.650478 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ad875cd8-92c2-4d26-b6b4-0213b51011b6 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1319 microversion: 2.1 time: 0.156411 Jul 21 05:46:35.651095 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 144/281] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:35 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:46:36.668325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:46:36.668905 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:46:36.676405 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:36.676849 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:36.677980 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:46:36.678488 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:46:36.814028 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:46:36.822118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2626fa59-b503-4699-93b5-d12f3cd76b80 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1508 microversion: 2.1 time: 0.157708 Jul 21 05:46:36.822717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 138/282] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:46:36 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:05.530260 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 05:47:05.530836 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 05:47:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 05:47:22.660827 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8b5a777c-5d1f-488b-8e7d-1d7e52c18537 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d64144-cce0-4e16-9c32-2f7f2cfff861", "device": "/dev/sdb"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:47:22.662500 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8b5a777c-5d1f-488b-8e7d-1d7e52c18537 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:22.665115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:22.666667 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=55 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:22.673568 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5a777c-5d1f-488b-8e7d-1d7e52c18537 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:22.674047 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5a777c-5d1f-488b-8e7d-1d7e52c18537 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:22.674824 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5a777c-5d1f-488b-8e7d-1d7e52c18537 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:22.675445 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5a777c-5d1f-488b-8e7d-1d7e52c18537 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:23.036793 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8b5a777c-5d1f-488b-8e7d-1d7e52c18537 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "POST /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380420 Jul 21 05:47:23.037840 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 145/283] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 05:47:22 2022] POST /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:47:31.956380 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a6e20dd2-966c-4078-a2d2-f49ee51067b7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Action: 'create', calling method: .version_select at 0x7f509053d790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1166173600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvumasxtBVsFF2bm0cONNd1vrSuy1yzdUGMs51PrK/+jD8svo+EnCXx7K7V9jPi23yoSI0nKCA0ZUyjQ6wr2m3lkWo8dsGjMYoyCTm61NO2wr4MS2UvaQd6Nhmw32Nshw=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:47:31.960915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=15 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:31.961524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=83 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:31.974200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-a6e20dd2-966c-4078-a2d2-f49ee51067b7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Getting quotas for project c1c0c1c0f91147b98e49acb05e14d2d2. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:47:31.978232 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-a6e20dd2-966c-4078-a2d2-f49ee51067b7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Getting quotas for user 22b285ea44c0494d9fa611df20d66a27 and project c1c0c1c0f91147b98e49acb05e14d2d2. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:47:32.002180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a6e20dd2-966c-4078-a2d2-f49ee51067b7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052420 Jul 21 05:47:32.002797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 139/284] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 05:47:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:47:32.061408 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1116675897", "imageRef": "33a1b186-9f1e-4e21-83b8-e4fe94c62e98", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1166173600", "networks": [{"uuid": "f4189370-5389-484d-9228-a9feae1469dc"}]}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:47:32.114414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.network.neutron [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] validate_networks() for [('f4189370-5389-484d-9228-a9feae1469dc', None, None, None, None, None)] {{(pid=124329) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:47:32.531478 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Flavor limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:47:32.531888 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Image limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:47:32.532348 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Flavor pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:47:32.532737 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Image pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:47:32.533134 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:47:32.544971 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:32.545655 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:32.546937 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:32.547624 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:32.564981 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Getting quotas for project c1c0c1c0f91147b98e49acb05e14d2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:47:32.569396 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Getting quotas for user 22b285ea44c0494d9fa611df20d66a27 and project c1c0c1c0f91147b98e49acb05e14d2d2. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:47:32.581246 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Going to run 1 instances... {{(pid=124329) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:47:32.583615 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='33a1b186-9f1e-4e21-83b8-e4fe94c62e98',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:47:32.630850 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-1dcc477a-595d-4a16-a2bd-24a8127db214 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577111 Jul 21 05:47:32.631526 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 146/285] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:47:32.644804 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6019bf9a-76f0-4c39-8758-13d27b882d1b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:32.645498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6019bf9a-76f0-4c39-8758-13d27b882d1b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:32.709123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6019bf9a-76f0-4c39-8758-13d27b882d1b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:32.715925 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6019bf9a-76f0-4c39-8758-13d27b882d1b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1259 microversion: 2.1 time: 0.075692 Jul 21 05:47:32.716492 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 140/286] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:32 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:33.735767 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:33.736420 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:33.743924 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:33.744367 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:33.745118 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:33.745539 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:33.807765 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:33.818281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-15b621fe-e25d-490c-a808-65ad66a8200b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1263 microversion: 2.1 time: 0.086980 Jul 21 05:47:33.818815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 147/287] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:33 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:34.838108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:34.839413 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:34.847713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:34.848160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:34.848929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:34.849361 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:34.911707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:34.919202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b37bd8d0-8a45-4e5f-a86b-7be2f61504ed tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1263 microversion: 2.1 time: 0.085161 Jul 21 05:47:34.919700 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 141/288] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:34 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:35.939651 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:35.940468 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:35.950889 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:35.951614 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:35.952776 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:35.953466 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:36.018739 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:36.026548 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5e133e23-2ebf-4d80-8a4b-d9dd9f114e95 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1311 microversion: 2.1 time: 0.093077 Jul 21 05:47:36.027173 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 148/289] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:35 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:37.056168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:37.057153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:37.064475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:37.064960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:37.065727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:37.066165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:37.350264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:37.358229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c20c55eb-bb6f-4569-8834-a18cd9f421aa tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.312872 Jul 21 05:47:37.358882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 142/290] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:37 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:38.286794 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-48cbce34-1bfb-4f33-ab71-40198760dab9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:38.287993 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-48cbce34-1bfb-4f33-ab71-40198760dab9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:38.298411 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48cbce34-1bfb-4f33-ab71-40198760dab9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:38.299190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48cbce34-1bfb-4f33-ab71-40198760dab9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:38.300464 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48cbce34-1bfb-4f33-ab71-40198760dab9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:38.301138 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48cbce34-1bfb-4f33-ab71-40198760dab9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:38.331823 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-48cbce34-1bfb-4f33-ab71-40198760dab9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/ips" status: 200 len: 151 microversion: 2.20 time: 0.051812 Jul 21 05:47:38.332509 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 149/291] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jul 21 05:47:38 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/ips => generated 151 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:47:38.375872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:38.376478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:38.383329 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:38.383768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:38.384537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:38.384960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:38.517906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:38.528283 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dd0fbbcc-c776-4b98-b264-a870b650810a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.156079 Jul 21 05:47:38.528862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 143/292] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:38 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:39.547795 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:39.548513 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:39.555223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:39.555667 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:39.556416 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:39.556841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:39.692190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:39.699831 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8b5de7ed-db21-4440-9aeb-f4a4e8345f06 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.156196 Jul 21 05:47:39.700385 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 150/293] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:39 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:40.717087 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:40.717763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:40.726470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:40.726899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:40.728713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:40.729371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:40.877895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:40.885861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-59971a2e-f5fb-408a-9086-c2634c93b55f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.172658 Jul 21 05:47:40.886431 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 144/294] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:40 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:41.903719 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:41.904397 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:41.911992 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:41.912432 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:41.913199 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:41.913633 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:42.048157 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:42.056639 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-1942fd5a-7b85-474a-a65a-8bcf82a669ab tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.156744 Jul 21 05:47:42.057216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 151/295] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:41 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:43.075242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:43.075801 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:43.077781 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=6 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:43.083370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:43.083805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:43.084553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:43.084963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:43.226134 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:43.236663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-597f1a30-b427-40e3-9f58-7e6e7dd57046 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.165377 Jul 21 05:47:43.237223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 145/296] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:43 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:44.253770 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:44.254524 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:44.256563 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=2 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:44.257131 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=6 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:44.263491 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:44.263961 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:44.275547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:44.275994 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:44.568046 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:44.584597 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2f76600f-9190-4cab-af56-701ae2dcea36 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.334729 Jul 21 05:47:44.585188 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 152/297] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:44 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:45.601861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:45.602611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:45.609376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:45.609818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:45.610578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:45.614026 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:45.763054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:45.769940 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-60cee35e-b923-4736-a79e-977c1821af44 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.171922 Jul 21 05:47:45.770619 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 146/298] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:45 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:45.862981 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:47:45.863695 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:45.871107 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:45.871559 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:45.872332 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:45.872763 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:45.899144 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.objects.instance [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lazy-loading 'flavor' on Instance uuid 82c3106a-0a81-4575-b1a7-dc0fc54551e2 {{(pid=124329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:47:46.172067 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c0ebc020-5f3f-4300-aa06-3815c5f667a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/action" status: 202 len: 0 microversion: 2.20 time: 0.312838 Jul 21 05:47:46.172676 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 153/299] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jul 21 05:47:45 2022] POST /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:47:46.181185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:46.181794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:46.188300 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:46.188741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:46.189503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:46.189937 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:46.323153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:46.332047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:46.333633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:46.334782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-90b33018-2a69-40de-984f-c8bf960294af tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.157559 Jul 21 05:47:46.335392 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 147/300] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:46 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:46.791710 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:46.792317 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:46.798760 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:46.799232 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:46.799991 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:46.800389 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:46.932691 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:46.940773 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-646650a1-c904-4214-af16-2d23c4f8522d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.155037 Jul 21 05:47:46.941338 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 154/301] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:46 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:47.355827 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:47.357364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:47.365311 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:47.365815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:47.366983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:47.367491 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:47.511351 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:47.519707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:47.521209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:47.522360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-45e3216d-785d-4fef-8f1f-b3dcf6b7c1ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.170694 Jul 21 05:47:47.522919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 148/302] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:47 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:47.958525 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:47.959161 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:47.966222 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:47.966665 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:47.967479 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:47.967911 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:48.101114 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:48.108709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2ebb80a1-a97c-4396-a2e3-c1aefa204838 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.154688 Jul 21 05:47:48.109260 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 155/303] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:47 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:48.541142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:48.541989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:48.549419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:48.549972 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:48.550817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:48.551409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:48.687545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:48.695829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:48.697346 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:48.698539 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-033e1b19-b019-49b7-bbaa-d2cf9f83fc0d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.161509 Jul 21 05:47:48.699330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 149/304] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:48 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:49.127181 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:49.128000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:49.135782 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:49.136272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:49.137049 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:49.137480 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:49.275977 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:49.286326 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-3da35bcf-183f-4e71-9320-fb90210880e6 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.163862 Jul 21 05:47:49.286907 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 156/305] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:49 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:49.716837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:49.717489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:49.724379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:49.724822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:49.725595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:49.726020 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:49.866841 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:49.875133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:49.876826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:49.878045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-88d9dcf9-b121-4218-8029-c6ae6e819ec0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.165137 Jul 21 05:47:49.889233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 150/306] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:49 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:50.307869 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:50.308617 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:50.316587 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:50.317099 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:50.317973 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:50.318465 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:50.453205 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:50.461157 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f2cb0908-f1b6-4756-962d-b8074ea0cdae tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.160012 Jul 21 05:47:50.461708 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 157/307] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:50 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:50.901044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:50.901921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:50.909407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:50.909845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:50.910611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:50.911055 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:51.040488 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:51.052833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:51.055048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:51.056755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ff70158b-5c38-41dd-ac00-91441cb24556 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.162291 Jul 21 05:47:51.057512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 151/308] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:50 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:51.478325 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:51.478886 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:51.486703 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:51.487330 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:51.488164 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:51.488597 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:51.627447 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:51.638803 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a9d4f44e-dcbc-4848-94be-33e981d7fe4a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.164131 Jul 21 05:47:51.639636 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 158/309] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:51 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:52.083597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:52.084309 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:52.092862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:52.093497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:52.094474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:52.095068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:52.484281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:52.492355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:52.493915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:52.495050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3bfda2b6-a6e3-4c7b-a9be-1a19afa3c562 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.416787 Jul 21 05:47:52.495628 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 152/310] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:52 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:52.662878 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:52.663954 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:52.672634 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:52.673077 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:52.673840 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:52.674278 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:52.678368 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:52.808947 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:52.818185 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-fe494a84-0b5e-4f8e-8d69-06b8c7eba085 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.162263 Jul 21 05:47:52.818784 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 159/311] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:52 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:53.514073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:53.514686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:53.522622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:53.523048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:53.523886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:53.524302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:53.774212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:53.782717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:53.784566 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:53.785647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-23f4d850-8565-49a6-9a57-4ecb05f3773e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.275768 Jul 21 05:47:53.786191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 153/312] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:53 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:53.835862 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:53.836449 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:53.839542 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:53.844744 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:53.845187 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:53.845945 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:53.846380 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:53.903973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-550ef4c1-8c2d-497e-a623-cd5ed3f52f19 req-af26f789-cd48-4099-80bf-f753a0999564 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a780a3-33bf-4c98-9363-3f5044165def", "tag": "65160de7-4ce4-43e2-81e4-3e79539be1e9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:47:53.917697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-550ef4c1-8c2d-497e-a623-cd5ed3f52f19 req-af26f789-cd48-4099-80bf-f753a0999564 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:53.918504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-550ef4c1-8c2d-497e-a623-cd5ed3f52f19 req-af26f789-cd48-4099-80bf-f753a0999564 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:53.931226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-550ef4c1-8c2d-497e-a623-cd5ed3f52f19 req-af26f789-cd48-4099-80bf-f753a0999564 service nova] Creating event network-changed:65160de7-4ce4-43e2-81e4-3e79539be1e9 for instance 04a780a3-33bf-4c98-9363-3f5044165def on hv-cinder-85044 Jul 21 05:47:53.938181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-550ef4c1-8c2d-497e-a623-cd5ed3f52f19 req-af26f789-cd48-4099-80bf-f753a0999564 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038131 Jul 21 05:47:53.940043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 154/313] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:47:54.101638 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:54.110130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c51c8d8e-c7b2-4c68-8346-facb3c7182bf tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.278139 Jul 21 05:47:54.111198 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 160/314] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:53 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:54.805728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:54.806421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:54.813231 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:54.813676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:54.814433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:54.814870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:54.950848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:54.958954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:54.960488 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:54.961638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d191b74a-563f-4d47-b916-a4e334c2b2e8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.160847 Jul 21 05:47:54.962362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 155/315] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:54 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:55.129110 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:55.129777 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:55.138063 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:55.138498 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:55.139286 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:55.139709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:55.284280 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:55.292101 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-78682425-c136-4e0a-9af6-2ef88134ebd3 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.167638 Jul 21 05:47:55.292869 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 161/316] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:55 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:55.984459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:55.985259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:55.996483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:55.997185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:55.998502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:55.999225 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:56.151094 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:56.160815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:56.162344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:56.163556 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3726d065-5f54-41dc-810b-a0a2975e538f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.185966 Jul 21 05:47:56.164113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 156/317] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:55 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:56.309598 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:56.310173 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:56.316964 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:56.317406 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:56.318171 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:56.318600 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:56.342828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:56.343876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:56.349837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:56.350459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:56.351490 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:56.351926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:56.457060 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:56.464575 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-48f1bbd3-56d2-4ed6-b790-5a43274f5dbd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.159360 Jul 21 05:47:56.465435 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 162/318] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:56 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:56.476586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lazy-loading 'services' on Instance uuid 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:47:56.510261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:47:56.597736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-561d7af9-d592-4e61-beb0-1f89de074596 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67/os-volume_attachments/79d64144-cce0-4e16-9c32-2f7f2cfff861" status: 202 len: 0 microversion: 2.1 time: 0.258679 Jul 21 05:47:56.598324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 157/319] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 05:47:56 2022] DELETE /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67/os-volume_attachments/79d64144-cce0-4e16-9c32-2f7f2cfff861 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:47:57.185077 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:57.185924 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:57.195830 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:57.196516 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:57.197674 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:57.198318 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:57.340159 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:57.348529 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:57.350023 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:57.351182 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-fb39e89e-2815-4a2a-889a-0f7678c03e2a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.172482 Jul 21 05:47:57.351735 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 163/320] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:57 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:57.485282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:57.486967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:57.495484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:57.496080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:57.497085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:57.497649 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:57.636816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:57.647486 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ea3a9c83-3d76-4c9b-a86b-3f276cf2a0cb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.168709 Jul 21 05:47:57.648056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 158/321] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:57 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:58.374291 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:58.375210 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:58.382992 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:58.383488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:58.384286 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:58.384737 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:58.524885 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:58.533321 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:58.535223 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:58.536369 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-4b6bbf36-1853-4926-90f8-b8e6bb726734 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.168988 Jul 21 05:47:58.536925 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 164/322] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:58 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:58.665642 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:58.666256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:58.673565 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:58.674017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:58.674783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:58.675276 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:58.908884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:58.916649 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-21e15f4f-f33f-4e53-921e-844b13ecac6f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.254930 Jul 21 05:47:58.917174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 159/323] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:58 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:47:59.559552 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:59.560378 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:59.571569 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.572302 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:59.573531 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.574229 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:59.707645 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:59.715911 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:59.717402 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:47:59.718546 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-1b41867d-82b2-452f-8b6e-cca3cfff6e74 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.165693 Jul 21 05:47:59.719128 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 165/324] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:47:59 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:47:59.821854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:59.822372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:59.829296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.829740 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:59.830503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.830936 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:59.857339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:47:59.933344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:59.933957 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:59.947835 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.948272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:59.949009 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.949436 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:59.950444 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-db058722-c718-435e-8e30-b298064427b4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 204 len: 0 microversion: 2.1 time: 0.132294 Jul 21 05:47:59.954930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 160/325] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:47:59 2022] DELETE /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:47:59.960895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:47:59.961583 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:47:59.968032 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.968468 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:47:59.969219 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:47:59.969644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:00.140672 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:00.148667 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f536e082-9708-460b-9849-f34ef22c7a37 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.219091 Jul 21 05:48:00.149218 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 166/326] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:59 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:48:00.151591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:00.160828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-73b1a745-b18e-4b6f-8e05-cf929a322b53 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1514 microversion: 2.1 time: 0.203812 Jul 21 05:48:00.161673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 161/327] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:47:59 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:00.737487 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:00.738077 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:00.745164 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:00.745613 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:00.746375 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:00.746802 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:00.789175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-a4b92a58-7ba2-4a33-b6e2-dac3cdfd3413 req-c3ee2b57-fad8-4d3f-a9ed-416ccd44b809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a780a3-33bf-4c98-9363-3f5044165def", "name": "network-vif-plugged", "status": "completed", "tag": "65160de7-4ce4-43e2-81e4-3e79539be1e9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:00.798363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a4b92a58-7ba2-4a33-b6e2-dac3cdfd3413 req-c3ee2b57-fad8-4d3f-a9ed-416ccd44b809 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:00.798920 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a4b92a58-7ba2-4a33-b6e2-dac3cdfd3413 req-c3ee2b57-fad8-4d3f-a9ed-416ccd44b809 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:00.811048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-a4b92a58-7ba2-4a33-b6e2-dac3cdfd3413 req-c3ee2b57-fad8-4d3f-a9ed-416ccd44b809 service nova] Creating event network-vif-plugged:65160de7-4ce4-43e2-81e4-3e79539be1e9 for instance 04a780a3-33bf-4c98-9363-3f5044165def on hv-cinder-85044 Jul 21 05:48:00.816176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-a4b92a58-7ba2-4a33-b6e2-dac3cdfd3413 req-c3ee2b57-fad8-4d3f-a9ed-416ccd44b809 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030774 Jul 21 05:48:00.816895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 162/328] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:48:00.883375 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:00.892150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:00.893639 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:00.894775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-1d74104c-1094-463e-8336-d6d3f3e4bb63 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.161371 Jul 21 05:48:00.895366 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 167/329] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:00 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:01.171425 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:01.172582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:01.183521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:01.184719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:01.185551 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:01.185981 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:01.186480 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:01.186683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:01.193921 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:01.194382 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:01.195166 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:01.195592 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:01.380794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:01.383751 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:01.388798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e88bcb23-e022-46ee-b802-7b0307e7ac07 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.225312 Jul 21 05:48:01.389566 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 163/330] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:01 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:01.391394 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f51a9a9b-5f0c-41c8-b89a-f0ec7d885ac5 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1514 microversion: 2.1 time: 0.212263 Jul 21 05:48:01.391915 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 168/331] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:01 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:01.917577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:01.918568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:01.928903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:01.929639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:01.930882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:01.931663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:02.070942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:02.082830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:02.085211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:02.086889 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-63348aed-89b2-42a0-959c-5839a2676f07 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.175715 Jul 21 05:48:02.087623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 164/332] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:01 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:02.410579 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:02.411578 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:02.414329 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:02.415489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:02.421519 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:02.422121 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:02.422849 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:02.424175 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:02.424953 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:02.427741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:02.428200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:02.428960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:02.429385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:02.616879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:02.621464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:02.628025 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b6c95395-a1bf-41b9-a4de-961ab45e3920 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1359 microversion: 2.1 time: 0.224088 Jul 21 05:48:02.628926 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 169/333] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:02 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:02.630923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5e41e23e-84b1-4265-a4fb-899bbf7bb532 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1514 microversion: 2.1 time: 0.224916 Jul 21 05:48:02.631476 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 165/334] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:02 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1514 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:03.111895 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:03.112628 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:03.118956 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.119452 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.120216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.120664 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.325864 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:03.336033 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:03.337801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:03.338882 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ea1aec7f-99e7-4aac-ad9a-c7c9d11546f0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.233104 Jul 21 05:48:03.339806 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 170/335] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:03 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:03.433132 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-1d1d0cf1-6862-4e3f-b426-6e35642bc0c4 req-04579cb3-850c-4776-86c5-63126d3875db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67", "name": "network-vif-deleted", "tag": "74166195-78e3-4c32-8683-e0e6e946df06"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:03.442291 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1d1d0cf1-6862-4e3f-b426-6e35642bc0c4 req-04579cb3-850c-4776-86c5-63126d3875db service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.442716 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1d1d0cf1-6862-4e3f-b426-6e35642bc0c4 req-04579cb3-850c-4776-86c5-63126d3875db service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.453727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-1d1d0cf1-6862-4e3f-b426-6e35642bc0c4 req-04579cb3-850c-4776-86c5-63126d3875db service nova] Creating event network-vif-deleted:74166195-78e3-4c32-8683-e0e6e946df06 for instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 on hv-cinder-85044 Jul 21 05:48:03.458782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-1d1d0cf1-6862-4e3f-b426-6e35642bc0c4 req-04579cb3-850c-4776-86c5-63126d3875db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029363 Jul 21 05:48:03.459376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 166/336] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:03.650067 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:03.650955 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:03.656027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:03.657983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:03.662082 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.662812 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.663644 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.664070 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.665982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.666434 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.667407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.667820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.753704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:03.761573 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fdb8f123-c918-41f3-9596-5fd813fe84e4 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1472 microversion: 2.1 time: 0.114305 Jul 21 05:48:03.762131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 167/337] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:03 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:03.816694 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:03.824746 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c8b45f5d-745b-4b52-b4eb-3345c5485221 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1548 microversion: 2.1 time: 0.181675 Jul 21 05:48:03.825314 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 171/338] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:03 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1548 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:03.841978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:03.842572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:03.848904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.849376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.850123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:03.850551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:03.987516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:03.995268 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3793c3e0-cbd9-45b0-b76e-e37d3c9eed9b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1548 microversion: 2.1 time: 0.157111 Jul 21 05:48:03.995898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 168/339] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:03 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:04.011041 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:04.014556 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:04.015359 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Searching by: {'deleted': False, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2'} {{(pid=124329) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 05:48:04.022547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.023001 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.023801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.024233 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.125700 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.multi_cell_list [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124329) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 05:48:04.234379 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-bb3947b7-be99-4cef-b463-136bc1b6511c tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227016 Jul 21 05:48:04.234871 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 172/340] 10.222.0.44 () {58 vars in 1124 bytes} [Thu Jul 21 05:48:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:04.245291 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:04.245921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:04.252622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.253102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.253854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.254377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.358203 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:04.358815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:04.365316 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.365762 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.366534 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.366966 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.381355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:04.389103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2621e496-4e6d-4a52-8c9c-0329c312be0d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1548 microversion: 2.1 time: 0.147754 Jul 21 05:48:04.389698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 169/341] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:04 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:04.498701 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:04.506612 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:04.508108 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:04.509239 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-12a989ea-d471-4c8b-ac0f-b7c2959da442 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.155227 Jul 21 05:48:04.509796 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 173/342] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:04 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:04.778865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:04.779524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:04.786467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.786902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.787675 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.788101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.818319 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:04.818739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:04.819207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lazy-loading 'fault' on Instance uuid 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:48:04.870286 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:04.877919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-56589ccf-9d1b-4f36-8727-0c61b471b1ee tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 200 len: 1309 microversion: 2.1 time: 0.102952 Jul 21 05:48:04.878496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 170/343] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:04 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:05.532814 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:05.534081 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:05.542465 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:05.542935 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:05.543754 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:05.544181 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:05.680411 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:05.688883 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:05.690534 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:05.691818 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-493740c2-da47-4771-8125-bab3bd59a1c9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.166242 Jul 21 05:48:05.692379 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 174/344] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:05 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:05.897253 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:05.897957 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:05.906443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:05.906880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:05.907677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:05.908092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:05.922266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] HTTP exception thrown: Instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 could not be found. Jul 21 05:48:05.923310 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-77bddebf-fdec-4aec-9a6b-6dcf69fb5c64 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ebc025a-e5b2-4cf4-875e-7a0cbce3e176"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Request method failure captured: Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 HTTP/1.1 Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OgrGUNQ2AMNopZlf3K6OFfrMp72T-b6HXrXkACXVccE1fRK9TswKCIeq9NcZm6AkMjJoRzRfLdx-Z0vnIIs-Wej0MErJrzNdw9Eyi3BxwqjKONE7I5DGgtPoZYLylGCdUmDEwyoMDXHTn6yvBkufsfRVekIgd-49mnE-pa4O04TIjc Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: cb4a02ef918f418f9509f0698503f428 Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1220735106 Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:48:05.923963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cb4a02ef918f418f9509f0698503f428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cb4a02ef918f418f9509f0698503f428"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cb4a02ef918f418f9509f0698503f428", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cb4a02ef918f418f9509f0698503f428"}]}] Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesSnapshotTestJSON-1220735106 Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: cb4a02ef918f418f9509f0698503f428 Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1220735106 Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesSnapshotTestJSON-1220735106-project Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 5baede5b70674737ad285b5831e11002 Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesSnapshotTestJSON-1220735106-project Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 could not be found. Jul 21 05:48:05.925325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67'} Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 could not be found. Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:48:05.926190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 could not be found. Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 could not be found. Jul 21 05:48:05.927756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:48:05.929137 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-77bddebf-fdec-4aec-9a6b-6dcf69fb5c64 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:05.929227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Returning 404 to user: Instance 1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:48:05.929227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-61b423e1-71aa-4097-a668-21415a89535c tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67" status: 404 len: 111 microversion: 2.1 time: 0.033107 Jul 21 05:48:05.929227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 171/345] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:05 2022] GET /compute/v2.1/servers/1ac48dbd-57de-43cd-a4fc-76b3a2c4ae67 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:48:05.930505 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-77bddebf-fdec-4aec-9a6b-6dcf69fb5c64 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:05.930978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-77bddebf-fdec-4aec-9a6b-6dcf69fb5c64 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:05.931774 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-77bddebf-fdec-4aec-9a6b-6dcf69fb5c64 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:05.932206 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-77bddebf-fdec-4aec-9a6b-6dcf69fb5c64 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:05.948801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=100 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:06.214245 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-77bddebf-fdec-4aec-9a6b-6dcf69fb5c64 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294700 Jul 21 05:48:06.214861 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 175/346] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 05:48:05 2022] POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:48:06.711363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:06.712205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:06.720776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:06.721380 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:06.722398 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:06.722999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:06.869789 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:06.881931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:06.884112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:06.885802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3c0ddc21-6c97-4eb7-b8b6-68b7c2075ede tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.179266 Jul 21 05:48:06.886543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 172/347] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:06 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:07.912497 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:07.913314 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:07.922049 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:07.922599 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:07.923662 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:07.924193 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:08.072437 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:08.080781 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:08.082283 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:08.083452 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5b36280c-991f-486c-a13d-ce4cdd713bdd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.178469 Jul 21 05:48:08.083991 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 176/348] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:07 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:09.106071 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:09.106985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:09.116922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:09.117361 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:09.118116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:09.118533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:09.261671 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:09.273880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:09.276316 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:09.278070 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8c221854-c8a4-48eb-a3fc-9b101b5d29b1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.178401 Jul 21 05:48:09.278835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 173/349] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:09 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:10.300244 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:10.302289 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:10.307582 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:10.308140 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:10.308721 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:10.309152 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:10.440604 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:10.448862 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:10.450414 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:10.451539 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e64dfaef-a53d-4dce-b7b7-36df8d7061d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.155335 Jul 21 05:48:10.452308 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 177/350] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:10 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:11.473970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:11.474773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:11.486041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:11.486787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:11.488104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:11.488832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:11.493532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:11.629254 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:11.637853 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:11.639376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:11.640537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-40bea94e-628a-427c-8649-9d97aec84dd9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.173396 Jul 21 05:48:11.641085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 174/351] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:11 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:12.662384 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:12.662984 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:12.669967 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:12.670405 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:12.671217 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:12.671643 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:12.803270 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:12.814035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:12.815541 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:12.816677 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a36d7b40-2423-40dc-b456-eb943edb2884 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.158615 Jul 21 05:48:12.817217 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 178/352] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:12 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:13.838842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:13.839732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:13.849464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:13.849928 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:13.850685 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:13.851136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:13.984568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:13.992572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:13.994082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:13.995265 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8d539633-7ffe-48e5-ad82-393228fbb92b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1743 microversion: 2.20 time: 0.162919 Jul 21 05:48:13.995824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 175/353] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:13 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:14.724746 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-eb09c9c4-98b4-472f-a0ce-ea9cb0bcf2a6 req-8f8cfe9e-fca9-4b85-acce-241c3b0e18ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c3106a-0a81-4575-b1a7-dc0fc54551e2", "name": "network-vif-plugged", "status": "completed", "tag": "38bd4456-0aed-49a5-99eb-1bfcf154ecc0"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:14.733439 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=2 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:14.735863 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-eb09c9c4-98b4-472f-a0ce-ea9cb0bcf2a6 req-8f8cfe9e-fca9-4b85-acce-241c3b0e18ae service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:14.736774 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-eb09c9c4-98b4-472f-a0ce-ea9cb0bcf2a6 req-8f8cfe9e-fca9-4b85-acce-241c3b0e18ae service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:14.758797 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-eb09c9c4-98b4-472f-a0ce-ea9cb0bcf2a6 req-8f8cfe9e-fca9-4b85-acce-241c3b0e18ae service nova] Creating event network-vif-plugged:38bd4456-0aed-49a5-99eb-1bfcf154ecc0 for instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 on hv-cinder-85044 Jul 21 05:48:14.771824 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-eb09c9c4-98b4-472f-a0ce-ea9cb0bcf2a6 req-8f8cfe9e-fca9-4b85-acce-241c3b0e18ae service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050642 Jul 21 05:48:14.772565 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 179/354] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:15.013694 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:15.014332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:15.021295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:15.021775 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:15.022544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:15.023059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:15.177515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:15.186692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:15.188363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:15.189734 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a9f04a29-7e1b-41b0-9a6a-a205dd2b37ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.180014 Jul 21 05:48:15.190371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 176/355] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:15 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:16.215395 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:16.216988 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:16.223613 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:16.224126 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:16.224982 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:16.225576 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:16.366237 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:16.376150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:16.378076 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:16.380064 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8d913ced-c70c-43ed-801b-2c18c50e7157 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.169641 Jul 21 05:48:16.381358 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 180/356] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:16 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:17.399574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:17.400858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:17.407816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:17.408816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:17.409735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:17.410308 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:17.576177 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:17.585154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:17.592011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:17.593604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-36f99b65-8f3a-4b10-8c5c-9d806249304d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.197983 Jul 21 05:48:17.594656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 177/357] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:17 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:18.613225 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:18.613855 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:18.620699 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:18.621119 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:18.622191 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:18.622769 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:18.776272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:18.788634 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:18.790205 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:18.791479 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ac4d46fb-0901-487b-b2b3-22b9dae13a87 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.182467 Jul 21 05:48:18.795361 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 181/358] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:18 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:19.810007 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:19.811418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:19.818253 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:19.818710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:19.819574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:19.820006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:19.992904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:20.019218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:20.021366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:20.030017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a02b35fe-4a9f-45e9-af93-41977fbc75fe tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.223500 Jul 21 05:48:20.032333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 178/359] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:19 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:20.163205 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-331108697", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "networks": [{"uuid": "9c5da2f1-0c1d-481d-978e-bb853c4d8861"}]}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:20.227217 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.network.neutron [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] validate_networks() for [('9c5da2f1-0c1d-481d-978e-bb853c4d8861', None, None, None, None, None)] {{(pid=124329) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:48:20.932504 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Flavor limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:48:20.932924 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Image limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:48:20.933388 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Flavor pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:48:20.933788 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Image pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:48:20.934188 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:48:20.943395 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:20.943829 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:20.944653 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:20.945075 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:20.962359 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Getting quotas for project cb4a02ef918f418f9509f0698503f428. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:48:20.966336 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Getting quotas for user 5baede5b70674737ad285b5831e11002 and project cb4a02ef918f418f9509f0698503f428. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:48:20.977720 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Going to run 1 instances... {{(pid=124329) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:48:20.980066 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:48:21.029648 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b87fc7ca-dd3a-4885-b8af-f738963067de tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870249 Jul 21 05:48:21.030399 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 182/360] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:48:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:48:21.042177 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fcc03f97-d26d-486c-bd84-3f300a9d06ff tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:21.042856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fcc03f97-d26d-486c-bd84-3f300a9d06ff tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:21.054841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:21.055442 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:21.062356 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:21.062793 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:21.063589 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:21.064016 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:21.253362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fcc03f97-d26d-486c-bd84-3f300a9d06ff tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:21.267538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fcc03f97-d26d-486c-bd84-3f300a9d06ff tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1218 microversion: 2.1 time: 0.230217 Jul 21 05:48:21.278132 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 179/361] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:21 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1218 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:21.338122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:21.339318 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:21.347774 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:21.348251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:21.349187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:21.349783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:21.384920 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:21.397157 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:21.399669 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:21.400928 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-57b71e12-3d6c-48c0-8a31-06e45be567fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.350722 Jul 21 05:48:21.401936 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 183/362] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:21 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:21.517506 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:21.534504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1d68e248-87cb-44de-8e92-fd012d2c750f tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1594 microversion: 2.1 time: 0.202603 Jul 21 05:48:21.539861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 180/363] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:21 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1594 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:48:22.288094 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:22.289117 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:22.300856 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:22.307824 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:22.309603 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:22.310242 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:22.426687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:22.427409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:22.431706 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:22.439195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:22.440076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:22.443510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:22.444210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:22.449022 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a5a1a18c-9d8f-4c0f-9aa9-7a26cbec77f1 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1270 microversion: 2.1 time: 0.162262 Jul 21 05:48:22.449686 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 184/364] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:22 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:22.757382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:22.767947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:22.769764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:22.771205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-69f5483e-82f1-4daf-8ab6-01b06c06314e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.352579 Jul 21 05:48:22.772280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 181/365] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:22 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:23.467955 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:23.468689 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:23.480457 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:23.481238 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:23.484489 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:23.486295 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:23.587048 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:23.595646 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8dc1e183-d859-4915-8e9c-3bc4be85cd4f tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1276 microversion: 2.1 time: 0.131456 Jul 21 05:48:23.596179 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 185/366] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:23 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:23.792633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:23.794219 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:23.804970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:23.805779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:23.807079 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:23.807776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:24.202818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:24.211403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:24.221385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:24.222789 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fa10d7d7-7266-4552-ab0f-9af4f652a26e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.436468 Jul 21 05:48:24.223693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 182/367] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:23 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:24.613373 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:24.614005 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:24.616630 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:24.622322 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:24.622763 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:24.623562 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:24.623987 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:25.023497 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:25.031732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-7c5fee29-d9a6-4ddd-88e9-4d699c600987 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.422405 Jul 21 05:48:25.032296 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 186/368] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:24 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:25.193863 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-21a7b0f3-a05c-43b7-b459-0bb099cd7f44 req-9e60760a-f533-4d2c-8964-3bf0ca4a8f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a780a3-33bf-4c98-9363-3f5044165def", "tag": "65160de7-4ce4-43e2-81e4-3e79539be1e9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:25.208425 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-21a7b0f3-a05c-43b7-b459-0bb099cd7f44 req-9e60760a-f533-4d2c-8964-3bf0ca4a8f40 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:25.216118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-21a7b0f3-a05c-43b7-b459-0bb099cd7f44 req-9e60760a-f533-4d2c-8964-3bf0ca4a8f40 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:25.235183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-21a7b0f3-a05c-43b7-b459-0bb099cd7f44 req-9e60760a-f533-4d2c-8964-3bf0ca4a8f40 service nova] Creating event network-changed:65160de7-4ce4-43e2-81e4-3e79539be1e9 for instance 04a780a3-33bf-4c98-9363-3f5044165def on hv-cinder-85044 Jul 21 05:48:25.240928 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:25.241536 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:25.250360 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:25.251404 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:25.252826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-21a7b0f3-a05c-43b7-b459-0bb099cd7f44 req-9e60760a-f533-4d2c-8964-3bf0ca4a8f40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062785 Jul 21 05:48:25.253354 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:25.253945 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 183/369] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:25.254118 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:25.465360 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:25.481452 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:25.485158 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:25.487783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-728e3aab-7d28-4ae0-9016-8bfa02dd1962 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1738 microversion: 2.20 time: 0.250900 Jul 21 05:48:25.504289 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 187/370] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:25 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:26.049520 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:26.050640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:26.059423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:26.060080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:26.061915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:26.062658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:26.338224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:26.349144 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-16c0d3c5-8a69-411f-9a29-ae79a07a8858 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.304019 Jul 21 05:48:26.350177 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 184/371] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:26 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:48:26.508108 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:26.509581 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:26.516389 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:26.516807 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:26.517570 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:26.518000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:26.697713 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:26.706187 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:26.707760 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:26.708911 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c1741c7f-5b0d-4fb0-b958-42c8b898dc7c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1720 microversion: 2.20 time: 0.205265 Jul 21 05:48:26.709446 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 188/372] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:26 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:26.905542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-409212758"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:26.906082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:26.912902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:26.913347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:26.914106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:26.914537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.044197 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.network.security_group_api [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Adding security group 99580340-eed9-4481-acc2-e2affe9ec140 to port 65160de7-4ce4-43e2-81e4-3e79539be1e9 Jul 21 05:48:27.296067 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-959b4d35-2450-476d-822a-70d029e9ff58 req-9afa042c-e5d2-4bb8-a3d0-4fdd63ed9268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcfc2e65-4388-4ea5-bce8-f1af904b22bf", "tag": "78e188e5-15c6-4fc3-9c8c-7f0ec3763fc6"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:27.304583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-959b4d35-2450-476d-822a-70d029e9ff58 req-9afa042c-e5d2-4bb8-a3d0-4fdd63ed9268 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:27.305020 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-959b4d35-2450-476d-822a-70d029e9ff58 req-9afa042c-e5d2-4bb8-a3d0-4fdd63ed9268 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.316341 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-959b4d35-2450-476d-822a-70d029e9ff58 req-9afa042c-e5d2-4bb8-a3d0-4fdd63ed9268 service nova] Creating event network-changed:78e188e5-15c6-4fc3-9c8c-7f0ec3763fc6 for instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf on hv-cinder-85044 Jul 21 05:48:27.321637 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-959b4d35-2450-476d-822a-70d029e9ff58 req-9afa042c-e5d2-4bb8-a3d0-4fdd63ed9268 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029263 Jul 21 05:48:27.322298 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 189/373] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:27.366685 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:27.367394 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:27.374645 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:27.375121 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.375887 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:27.376313 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.419758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-15786d07-6f50-4298-95f2-429476d44853 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/action" status: 202 len: 0 microversion: 2.1 time: 0.518106 Jul 21 05:48:27.420680 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 185/374] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:48:26 2022] POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:48:27.428570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:27.429439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:27.436089 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:27.436761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.437707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:27.438133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.619393 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:27.633291 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-7acd61c3-7deb-4935-afa5-7d9b42b49b40 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.271050 Jul 21 05:48:27.633905 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 190/375] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:27 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:27.665155 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:27.673414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c0eff3e8-e128-49ff-ae5f-596fb081cfc4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1640 microversion: 2.1 time: 0.248749 Jul 21 05:48:27.673983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 186/376] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:27 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1640 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:27.727877 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:27.728418 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:27.734741 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:27.735219 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.735978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:27.736410 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:27.866367 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:27.874731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:27.876328 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:27.877484 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e5e64f72-62d9-4acf-b32b-c967a6ee8c5b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1720 microversion: 2.20 time: 0.153755 Jul 21 05:48:27.878070 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 191/377] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:27 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:28.651110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:28.651666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:28.658715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:28.659467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:28.660679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:28.660679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:28.744127 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-bcfc90ea-5edd-46a7-a1fd-1d69b560f200 req-9b693eaa-3b53-45b3-a5aa-a6afb05e6f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c3106a-0a81-4575-b1a7-dc0fc54551e2", "name": "network-vif-unplugged", "status": "completed", "tag": "38bd4456-0aed-49a5-99eb-1bfcf154ecc0"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:28.752851 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-bcfc90ea-5edd-46a7-a1fd-1d69b560f200 req-9b693eaa-3b53-45b3-a5aa-a6afb05e6f8b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:28.753381 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-bcfc90ea-5edd-46a7-a1fd-1d69b560f200 req-9b693eaa-3b53-45b3-a5aa-a6afb05e6f8b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:28.766986 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-bcfc90ea-5edd-46a7-a1fd-1d69b560f200 req-9b693eaa-3b53-45b3-a5aa-a6afb05e6f8b service nova] Creating event network-vif-unplugged:38bd4456-0aed-49a5-99eb-1bfcf154ecc0 for instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 on hv-cinder-85044 Jul 21 05:48:28.772071 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-bcfc90ea-5edd-46a7-a1fd-1d69b560f200 req-9b693eaa-3b53-45b3-a5aa-a6afb05e6f8b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031885 Jul 21 05:48:28.772904 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 192/378] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:28.795871 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:28.803667 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1a4f9add-3c20-48e2-b837-abfc7bddd668 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.156936 Jul 21 05:48:28.804228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 187/379] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:28 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:28.898801 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:28.899423 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:28.906272 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:28.906709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:28.907513 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:28.907943 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:28.930197 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:29.053934 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:29.061946 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:29.063467 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:29.064613 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-766e3cee-c5bc-4df0-809d-ba4b41a008d2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1720 microversion: 2.20 time: 0.170336 Jul 21 05:48:29.065182 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 193/380] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:28 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:29.347113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-0a6c684f-9121-4427-8da6-d66cc0f8b795 req-002dfa84-4407-4a30-9c60-8183d9243287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a780a3-33bf-4c98-9363-3f5044165def", "tag": "65160de7-4ce4-43e2-81e4-3e79539be1e9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:29.359001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0a6c684f-9121-4427-8da6-d66cc0f8b795 req-002dfa84-4407-4a30-9c60-8183d9243287 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:29.359788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0a6c684f-9121-4427-8da6-d66cc0f8b795 req-002dfa84-4407-4a30-9c60-8183d9243287 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:29.372089 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-0a6c684f-9121-4427-8da6-d66cc0f8b795 req-002dfa84-4407-4a30-9c60-8183d9243287 service nova] Creating event network-changed:65160de7-4ce4-43e2-81e4-3e79539be1e9 for instance 04a780a3-33bf-4c98-9363-3f5044165def on hv-cinder-85044 Jul 21 05:48:29.377269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-0a6c684f-9121-4427-8da6-d66cc0f8b795 req-002dfa84-4407-4a30-9c60-8183d9243287 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034784 Jul 21 05:48:29.378047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 188/381] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:29.821056 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:29.821661 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:29.828603 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:29.829042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:29.829790 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:29.830207 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:29.959662 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:29.967999 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-e690dd9b-0b7b-4f81-a1dc-634a37e940d7 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.150883 Jul 21 05:48:29.968564 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 194/382] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:29 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:30.088176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:30.089214 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:30.100006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:30.100744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:30.101991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:30.102709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:30.245880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:30.257665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:30.259198 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:30.260364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e075f6f5-73b1-4bec-bd3e-ea172edec326 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1720 microversion: 2.20 time: 0.180266 Jul 21 05:48:30.260896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 189/383] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:30 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:30.984909 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:30.985486 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:30.987861 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=2 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:30.988518 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell0:SELECT=6 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:30.994173 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:30.994619 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:30.995421 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:30.995850 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:31.143356 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:31.150983 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5528f07b-82fc-49b5-be76-6cc1442a0170 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.169985 Jul 21 05:48:31.151622 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 195/384] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:30 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:31.285469 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:31.286056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:31.288630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:31.294673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:31.295116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:31.295882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:31.296311 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:31.501585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:31.513535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:31.515576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:31.517015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-56b8c469-2a0c-412a-9f8a-ee0d3df15e6f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1720 microversion: 2.20 time: 0.235985 Jul 21 05:48:31.517790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 190/385] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:31 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1720 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:32.168358 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:32.168952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:32.175707 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:32.176144 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:32.176888 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:32.177311 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:32.311840 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:32.319588 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ae33a723-9e5b-4ca0-b42b-a0152497a9ed tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.155327 Jul 21 05:48:32.320156 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 196/386] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:32 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:32.540504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:32.541090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:32.543905 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=56 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:32.550878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:32.551415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:32.552287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:32.552730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:32.705492 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:32.713538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:32.715039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:32.716242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-92a40058-360d-4ab1-a172-de474b813aff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1663 microversion: 2.20 time: 0.182741 Jul 21 05:48:32.716807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 191/387] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:32 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:32.734283 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-a9848fe0-7387-445a-99c1-43deb5d461c6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ea9443b-7652-4739-96d6-33d622471ed6"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:32.735375 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-a9848fe0-7387-445a-99c1-43deb5d461c6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:32.741492 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9848fe0-7387-445a-99c1-43deb5d461c6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:32.741931 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9848fe0-7387-445a-99c1-43deb5d461c6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:32.742720 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9848fe0-7387-445a-99c1-43deb5d461c6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:32.743179 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-a9848fe0-7387-445a-99c1-43deb5d461c6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:32.793923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-562bcf65-e6a8-4bdc-ac63-9ae073281ccc req-8d3d3cfd-b2b0-4891-a061-1f04e1200431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfc2e65-4388-4ea5-bce8-f1af904b22bf", "name": "network-vif-plugged", "status": "completed", "tag": "78e188e5-15c6-4fc3-9c8c-7f0ec3763fc6"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:32.802900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-562bcf65-e6a8-4bdc-ac63-9ae073281ccc req-8d3d3cfd-b2b0-4891-a061-1f04e1200431 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:32.803421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-562bcf65-e6a8-4bdc-ac63-9ae073281ccc req-8d3d3cfd-b2b0-4891-a061-1f04e1200431 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:32.816862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-562bcf65-e6a8-4bdc-ac63-9ae073281ccc req-8d3d3cfd-b2b0-4891-a061-1f04e1200431 service nova] Creating event network-vif-plugged:78e188e5-15c6-4fc3-9c8c-7f0ec3763fc6 for instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf on hv-cinder-85044 Jul 21 05:48:32.822254 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-562bcf65-e6a8-4bdc-ac63-9ae073281ccc req-8d3d3cfd-b2b0-4891-a061-1f04e1200431 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032221 Jul 21 05:48:32.823007 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 192/388] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:33.038783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-a9848fe0-7387-445a-99c1-43deb5d461c6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308504 Jul 21 05:48:33.039466 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 197/389] 10.222.0.44 () {62 vars in 1363 bytes} [Thu Jul 21 05:48:32 2022] POST /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 05:48:33.152824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f530d367-4043-4962-8f58-2126c26f9dfc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:33.153474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f530d367-4043-4962-8f58-2126c26f9dfc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:33.160450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f530d367-4043-4962-8f58-2126c26f9dfc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:33.160902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f530d367-4043-4962-8f58-2126c26f9dfc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:33.161705 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f530d367-4043-4962-8f58-2126c26f9dfc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:33.162155 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f530d367-4043-4962-8f58-2126c26f9dfc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:33.222667 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:33.255897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f530d367-4043-4962-8f58-2126c26f9dfc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/action" status: 202 len: 0 microversion: 2.20 time: 0.107510 Jul 21 05:48:33.256503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 193/390] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jul 21 05:48:33 2022] POST /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:48:33.264825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:33.265433 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:33.273167 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:33.273644 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:33.274753 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:33.275203 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:33.337092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:33.338011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:33.344516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:33.345233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:33.346172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:33.346604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:33.436986 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:33.446173 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:33.447702 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:33.448894 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-20d08f00-6417-4f6c-a40e-7a56f0f337a3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1749 microversion: 2.20 time: 0.188096 Jul 21 05:48:33.449434 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 198/391] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:33 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1749 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:33.502457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:33.510517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f1ab04a1-10b7-47c5-8433-30e415a27362 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.177661 Jul 21 05:48:33.511151 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 194/392] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:33 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:34.468570 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:34.469172 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:34.476022 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:34.476469 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:34.477611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:34.478044 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:34.527168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:34.527994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:34.535709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:34.536148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:34.536980 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:34.537330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:34.659559 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:34.670681 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:34.672474 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:34.673830 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-dd4dbe52-9d81-46af-af12-78e0465c99ce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1751 microversion: 2.20 time: 0.209176 Jul 21 05:48:34.674372 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 199/393] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:34 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1751 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:34.712840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:34.720527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-65b1db77-4351-45dc-91bc-28991e186eae tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1318 microversion: 2.1 time: 0.197419 Jul 21 05:48:34.721102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 195/394] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:34 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:48:35.693709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:35.694254 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:35.701823 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:35.702263 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:35.703058 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:35.703490 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:35.739197 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:35.739800 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:35.747180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:35.747584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:35.748743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:35.749172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:36.204812 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:36.213760 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:36.215316 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:36.216490 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ae1fc9ee-65b9-4dce-9c9b-51833d3fd448 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.526882 Jul 21 05:48:36.217275 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 200/395] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:35 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:36.255174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:36.263316 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bbe5bf5d-3581-44d4-990d-3df9e0725a35 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1506 microversion: 2.1 time: 0.528084 Jul 21 05:48:36.263892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 196/396] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:48:35 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:48:36.280174 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f6926f09-81f2-42f5-944f-fe607e782996 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46a8754f-0ac4-4c9b-8af6-752ba1ab17ea", "device": "/dev/sdb"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:36.281390 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f6926f09-81f2-42f5-944f-fe607e782996 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:36.288244 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6926f09-81f2-42f5-944f-fe607e782996 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:36.288785 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6926f09-81f2-42f5-944f-fe607e782996 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:36.289693 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6926f09-81f2-42f5-944f-fe607e782996 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:36.290072 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6926f09-81f2-42f5-944f-fe607e782996 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:36.557136 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f6926f09-81f2-42f5-944f-fe607e782996 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "POST /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280856 Jul 21 05:48:36.557815 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 201/397] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 05:48:36 2022] POST /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:48:37.235564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:37.236287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:37.243753 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:37.244119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:37.244895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:37.245326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:37.396650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:37.409230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:37.410904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:37.412555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-14521c00-673e-412f-88d8-1011fa87c609 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.181159 Jul 21 05:48:37.413162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 197/398] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:37 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:38.433716 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:38.434401 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:38.441117 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:38.441541 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:38.442312 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:38.442759 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:38.580047 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:38.588676 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:38.590204 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:38.591407 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5a3a0526-c54f-4486-b3b6-529a0a64ecb0 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.162770 Jul 21 05:48:38.591979 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 202/399] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:38 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:39.610169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:39.610915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:39.617984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:39.618432 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:39.619658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:39.620402 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:39.828253 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:39.841103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:39.842969 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:39.844155 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-61746519-d4b3-4fd4-bbee-65ce013b3779 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.238020 Jul 21 05:48:39.844673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 198/400] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:39 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:40.861818 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:40.862488 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:40.869362 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:40.869802 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:40.870616 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:40.871059 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:41.066639 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:41.077289 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:41.079568 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:41.081216 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8cec03d1-de9b-409d-8132-024fbb20e3ac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.223184 Jul 21 05:48:41.081908 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 203/401] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:40 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:42.100635 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:42.101270 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:42.108280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:42.109048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:42.109807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:42.110244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:42.255800 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:42.264953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:42.266480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:42.267705 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-08702adb-1ce8-41b9-9ba4-ae60448d4d72 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.171319 Jul 21 05:48:42.268241 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 199/402] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:42 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:43.286940 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:43.287572 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:43.294239 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:43.294657 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:43.295484 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:43.295901 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:43.439218 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:43.446637 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:43.448186 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:43.449588 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c6ecb937-33b7-4a4a-9d5b-27d990ba55ff tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.167094 Jul 21 05:48:43.451060 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 204/403] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:43 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:44.468710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:44.469451 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:44.476154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:44.476606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:44.477410 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:44.477836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:44.619706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:44.628727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:44.630202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:44.631377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-44f29d42-4154-4e1d-9a81-ec8306513642 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.166826 Jul 21 05:48:44.631926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 200/404] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:44 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:45.774896 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:45.775563 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:45.782021 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:45.782458 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:45.783614 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:45.784042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:45.931477 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:45.941012 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:45.942390 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:45.943566 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-56273c32-2a6f-4738-9f09-c1ecdb5ec0b2 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.297135 Jul 21 05:48:45.944115 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 205/405] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:45 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:46.967892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:46.969362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:46.977810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:46.978261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:46.979255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:46.979688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:47.122966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:47.132015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:47.133495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:47.134623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3f75a7a4-7cbc-45e9-86c1-6d795a420e37 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.176377 Jul 21 05:48:47.135201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 201/406] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:46 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:48.158480 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:48.159503 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:48.170850 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:48.171735 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:48.172670 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:48.173101 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:48.177597 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:48.306334 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:48.315268 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:48.316788 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:48.317928 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-13dc2314-d432-4db3-b070-2a08c9327167 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.166544 Jul 21 05:48:48.318478 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 206/407] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:48 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:49.339039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:49.339609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:49.348163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:49.348604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:49.349364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:49.349791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:49.483743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:49.492773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:49.494281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:49.495457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b057e152-9b91-4cae-aaa6-f2ab3fbdd9ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.162630 Jul 21 05:48:49.496014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 202/408] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:49 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:50.517949 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:50.519003 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:50.529945 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:50.530794 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:50.532058 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:50.532787 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:50.673978 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:50.683284 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:50.684789 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:50.686632 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-bbcf367c-467e-4765-a1f3-f3a58016b3a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.174988 Jul 21 05:48:50.687215 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 207/409] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:50 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:51.706237 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:51.706800 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:51.713938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:51.714385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:51.715180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:51.715611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:51.861814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:51.870572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:51.872085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:51.873229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d6f8d226-d0d9-4264-bbb6-7919bafe0880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.171157 Jul 21 05:48:51.873752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 203/410] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:51 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:52.892243 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:52.892876 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:52.901903 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:52.902359 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:52.903141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:52.903567 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:53.099892 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:53.108734 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:53.110215 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:53.111387 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-315a0060-92bc-416f-a7d5-00dbd68ed668 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.223136 Jul 21 05:48:53.111926 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 208/411] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:52 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:54.134236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:54.135195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:54.144585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:54.145032 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:54.145799 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:54.146236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:54.278185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:54.287896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:54.289476 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:54.290665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-51177518-cdda-4ef4-81cb-5772b4a6300d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.163299 Jul 21 05:48:54.291322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 204/412] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:54 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:55.309644 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:55.310241 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:55.312665 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=46 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:48:55.318220 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:55.318663 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:55.319464 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:55.319897 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:55.455520 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:55.464497 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:55.466002 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:55.467191 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-fefe8743-abcb-458f-a16b-52225d847ce3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.161475 Jul 21 05:48:55.467802 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 209/413] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:55 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:56.486805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:56.487423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:56.494522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:56.495027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:56.495926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:56.496361 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:56.627729 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:56.637190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:56.638946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:56.640124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d46564a2-fe7d-487c-b571-4f840962720f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.157765 Jul 21 05:48:56.643070 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 205/414] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:56 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:57.660611 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:57.661199 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:57.668303 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:57.668746 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:57.669504 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:57.669935 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:57.809009 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:57.817879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:57.819411 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:57.820551 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-06024a85-b048-46bb-adbd-0448972b9976 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.165190 Jul 21 05:48:57.821092 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 210/415] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:57 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:58.844944 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:48:58.845595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:58.852552 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:58.853007 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:58.853772 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:58.854321 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:58.985577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:58.994078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:58.995586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:48:58.996698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0d99e468-6a80-4fa7-80bb-42de17683f7f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.160211 Jul 21 05:48:58.997248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 206/416] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:48:58 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:48:59.939427 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2538953e-eeb0-4756-a425-fc148608869a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ba79229-9d39-4806-983b-c9ca8e08041b"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:48:59.940566 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2538953e-eeb0-4756-a425-fc148608869a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:48:59.946674 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2538953e-eeb0-4756-a425-fc148608869a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:59.947155 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2538953e-eeb0-4756-a425-fc148608869a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:48:59.947902 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2538953e-eeb0-4756-a425-fc148608869a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:48:59.948323 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2538953e-eeb0-4756-a425-fc148608869a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:00.015857 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:00.016461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:00.023449 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:00.023895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:00.024659 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:00.025088 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:00.159414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:00.168518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:00.169945 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:00.171136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-10d81688-04b1-4fe1-9789-554199cd6f6a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.159234 Jul 21 05:49:00.171692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 207/417] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:00 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:01.118958 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2538953e-eeb0-4756-a425-fc148608869a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.292103 Jul 21 05:49:01.119636 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 211/418] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 05:48:59 2022] POST /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments => generated 194 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:49:01.190097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:01.190865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:01.197660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:01.198096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:01.198857 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:01.199315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:01.336080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:01.344888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:01.346458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:01.347642 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cd91fdf4-92d5-49ff-9dff-7c27c42bb540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.161957 Jul 21 05:49:01.348246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 208/419] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:01 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:02.372177 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:02.373310 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:02.384095 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:02.384840 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:02.386063 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:02.386769 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:02.525217 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:02.534630 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:02.536158 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:02.537296 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-4fef9bb4-46ed-461d-b74a-fdbcc45f9e78 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.172966 Jul 21 05:49:02.537850 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 212/420] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:02 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:03.562518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:03.563404 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:03.566463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=38 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:03.572092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:03.572557 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:03.573344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:03.573773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:03.576330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:03.709320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:03.717835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:03.719352 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:03.720498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-74ecf46e-f2d9-4741-9e58-8a85ac5d4afd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.164755 Jul 21 05:49:03.721049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 209/421] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:03 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:04.743670 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:04.744689 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:04.756008 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:04.756748 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:04.758007 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:04.758722 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:04.894847 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:04.903267 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:04.904805 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:04.905959 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c8cf5556-af73-4205-9030-18e640a4b5ec tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.168983 Jul 21 05:49:04.906515 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 213/422] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:04 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:05.476634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-2d6e27a1-512a-43d0-a1ee-b42de1c3d3f8 req-285a7374-6e59-40e1-8869-6cc1b688c0ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c3106a-0a81-4575-b1a7-dc0fc54551e2", "name": "network-vif-plugged", "status": "completed", "tag": "38bd4456-0aed-49a5-99eb-1bfcf154ecc0"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:49:05.485762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2d6e27a1-512a-43d0-a1ee-b42de1c3d3f8 req-285a7374-6e59-40e1-8869-6cc1b688c0ba service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:05.486133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2d6e27a1-512a-43d0-a1ee-b42de1c3d3f8 req-285a7374-6e59-40e1-8869-6cc1b688c0ba service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:05.497879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-2d6e27a1-512a-43d0-a1ee-b42de1c3d3f8 req-285a7374-6e59-40e1-8869-6cc1b688c0ba service nova] Creating event network-vif-plugged:38bd4456-0aed-49a5-99eb-1bfcf154ecc0 for instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 on hv-cinder-85044 Jul 21 05:49:05.502917 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-2d6e27a1-512a-43d0-a1ee-b42de1c3d3f8 req-285a7374-6e59-40e1-8869-6cc1b688c0ba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029984 Jul 21 05:49:05.503545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 210/423] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:49:05.927967 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:05.928630 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:05.936661 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:05.937180 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:05.938071 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:05.938571 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:06.092748 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:06.101481 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:06.102967 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:06.104142 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-18513050-8747-4c6f-b081-fb5255696ffc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.181474 Jul 21 05:49:06.104704 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 214/424] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:05 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:07.129323 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:07.131411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:07.142371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:07.144466 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:07.144466 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:07.145213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:07.283569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:07.292467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:07.293964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:07.295146 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c93e8c0d-6f9c-49b5-83f7-2c83df883b6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.174150 Jul 21 05:49:07.295673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 211/425] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:07 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:08.316745 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:08.317587 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:08.327367 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:08.327995 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:08.329060 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:08.329667 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:08.463356 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:08.472254 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:08.473750 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:08.474899 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-00775f15-d347-4783-8a1f-5b12e1f99dd8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.163834 Jul 21 05:49:08.475495 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 215/426] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:08 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:09.497887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:09.498945 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:09.507610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:09.508056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:09.508817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:09.509245 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:09.655573 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:09.670736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:09.672315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:09.673510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-aa55ab73-67e0-4410-bfcd-24b66d4c3eeb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.182106 Jul 21 05:49:09.674061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 212/427] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:09 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:09.703661 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:49:09.704681 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:09.711546 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:09.711990 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:09.712751 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:09.713190 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:09.735637 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.objects.instance [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lazy-loading 'flavor' on Instance uuid c66ebf62-cfee-40f4-a957-c099e662d2b4 {{(pid=124329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:49:09.874542 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-33bcc7c8-8b94-4c62-aecc-578d76bd1441 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/action" status: 200 len: 32 microversion: 2.1 time: 0.174961 Jul 21 05:49:09.875183 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 216/428] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:49:09 2022] POST /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 05:49:09.884507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:09.885117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:09.891418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:09.891876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:09.892667 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:09.893099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:10.026897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:10.038010 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e21afdc4-37ac-49bc-b4fd-217f22841d40 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.157345 Jul 21 05:49:10.038549 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 213/429] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:09 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:10.693174 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:10.693818 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:10.700720 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:10.701310 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:10.702072 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:10.702526 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:10.835799 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:10.844293 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:10.845772 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:10.847000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-937edb0c-f8ca-43db-86fd-49e64fec2e16 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.158056 Jul 21 05:49:10.847597 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 217/430] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:10 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:11.059522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:11.060331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:11.069303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:11.069752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:11.070495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:11.070949 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:11.234218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:11.242494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-df0aae2f-8360-469a-b8f3-b27c34dd4221 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.189553 Jul 21 05:49:11.243053 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 214/431] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:11 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:11.869652 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:11.870648 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:11.880091 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:11.880539 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:11.881294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:11.881727 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:12.025744 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:12.035226 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:12.036724 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:12.037872 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d2f0bd75-2390-40b3-beec-2fc2bb1d5e14 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.174867 Jul 21 05:49:12.038426 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 218/432] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:11 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:12.266537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:12.267438 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:12.274939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:12.275417 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:12.276187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:12.276615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:12.415817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:12.424279 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7963cba5-8d6d-434e-99d5-b1ab549467f1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.166454 Jul 21 05:49:12.424948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 215/433] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:12 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:13.060753 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:13.061783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:13.069704 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:13.070146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:13.070901 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:13.071405 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:13.089366 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:13.202482 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:13.211482 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:13.212878 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:13.214050 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2631341b-5b06-4f4a-ae4b-23128d91764a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.160033 Jul 21 05:49:13.214612 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 219/434] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:13 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:13.446059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:13.447066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:13.456999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:13.457436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:13.458194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:13.458623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:13.594590 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:13.610168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5362f11c-1084-4300-ac27-10760c6fa111 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.170435 Jul 21 05:49:13.610943 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 216/435] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:13 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:14.232944 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:14.233547 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:14.240202 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:14.240645 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:14.241393 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:14.241823 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:14.396437 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:14.405248 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:14.406761 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:14.408285 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-8ccadc7b-0ad1-4de7-8afd-534c8d4bbac7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.178929 Jul 21 05:49:14.408841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 220/436] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:14 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:14.632183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:14.633076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:14.644059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:14.644792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:14.646090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:14.646803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:14.788148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:14.800025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6a493a42-4fef-41d7-a285-06ec3f800dd6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.174363 Jul 21 05:49:14.800779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 217/437] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:14 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:15.431041 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:15.431975 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:15.442985 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:15.443565 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:15.444649 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:15.445205 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:15.584923 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:15.593317 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:15.594808 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:15.595975 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-2337e092-7746-470e-b8fc-7bb8a0240a88 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1807 microversion: 2.20 time: 0.171548 Jul 21 05:49:15.596636 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 221/438] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:15 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:15.822661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:15.823310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:15.830582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:15.831145 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:15.831945 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:15.832381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:15.972392 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:15.980868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5be6eb41-5d53-4806-b4c0-7495190ea121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.162124 Jul 21 05:49:15.982083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 218/439] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:15 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:16.618101 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:16.619058 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:16.630130 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:16.630923 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:16.632200 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:16.632953 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:16.770294 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:16.778940 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:16.780485 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:16.781622 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b3d411f0-61ec-409b-a5c4-c1db8c09dbb8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1794 microversion: 2.20 time: 0.170184 Jul 21 05:49:16.782162 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 222/440] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:49:16 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1794 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:49:17.002661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:17.003648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:17.012082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:17.012642 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:17.013588 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:17.014110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:17.120450 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:17.120943 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:17.127129 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:17.127662 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:17.128445 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:17.128870 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:17.152629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:17.161285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7bde7154-4fef-4e93-9443-1d469832b046 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.165091 Jul 21 05:49:17.161855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 219/441] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:16 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:17.250339 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.objects.instance [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lazy-loading 'services' on Instance uuid bcfc2e65-4388-4ea5-bce8-f1af904b22bf {{(pid=124329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:49:17.384899 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-13a0e1f9-7e1c-4091-a06d-3a7a1a167fa3 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf/os-volume_attachments/46a8754f-0ac4-4c9b-8af6-752ba1ab17ea" status: 202 len: 0 microversion: 2.1 time: 0.268225 Jul 21 05:49:17.385577 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 223/442] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 05:49:17 2022] DELETE /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf/os-volume_attachments/46a8754f-0ac4-4c9b-8af6-752ba1ab17ea => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:49:18.179369 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:18.179947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:18.186761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:18.187238 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:18.188022 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:18.188445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:18.322739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:18.331308 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a694f32e-74ab-4b99-bbfb-6e5dbe89bda7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.156090 Jul 21 05:49:18.331881 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 220/443] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:18 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:18.512283 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:18.512844 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:18.519207 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:18.519643 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:18.520476 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:18.520904 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:18.546554 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Going to try to terminate instance {{(pid=124329) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:49:18.624060 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-fa5d1c44-13fc-4689-870f-6d4203dd0bba tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 204 len: 0 microversion: 2.1 time: 0.116331 Jul 21 05:49:18.624842 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 224/444] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:49:18 2022] DELETE /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:49:18.636198 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:18.637058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:18.644093 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:18.644591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:18.645445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:18.645882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:18.779886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:18.787845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3d43a7aa-1af8-4303-b2f5-3669aabf5eab tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1512 microversion: 2.1 time: 0.158095 Jul 21 05:49:18.788407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 221/445] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:18 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:19.356598 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:19.357879 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:19.366881 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:19.367346 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:19.368108 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:19.368528 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:19.505601 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:19.519221 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f69264e7-946c-45e5-b02e-9e91e6b30aca tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.172225 Jul 21 05:49:19.520169 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 225/446] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:19 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:19.807327 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:19.808088 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:19.816647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:19.817192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:19.817949 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:19.818373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:19.948676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:19.956288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8557d8a3-9e11-4400-875d-c72130491624 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1512 microversion: 2.1 time: 0.153863 Jul 21 05:49:19.956851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 222/447] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:19 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:20.538098 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:20.538705 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:20.545933 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:20.546369 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:20.547178 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:20.547582 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:20.681539 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:20.693347 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-285dd1e7-50b1-46a7-abb0-8a3ce95e9544 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.159474 Jul 21 05:49:20.693930 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 226/448] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:20 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:20.976425 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:20.977015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:20.986093 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:20.986679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:20.987894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:20.988519 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:21.192961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5baede5b70674737ad285b5831e11002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb4a02ef918f418f9509f0698503f428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:21.200982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cfe4b891-ee39-4e1f-9975-7376133e0313 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 200 len: 1512 microversion: 2.1 time: 0.231107 Jul 21 05:49:21.201531 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 223/449] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:20 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:21.436728 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-5d3d0494-d561-4dc7-af07-82e45f79cd3e req-553850ea-3c9b-4c88-88a3-46a6213b32fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcfc2e65-4388-4ea5-bce8-f1af904b22bf", "name": "network-vif-deleted", "tag": "78e188e5-15c6-4fc3-9c8c-7f0ec3763fc6"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:49:21.445241 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-5d3d0494-d561-4dc7-af07-82e45f79cd3e req-553850ea-3c9b-4c88-88a3-46a6213b32fa service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:21.445731 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-5d3d0494-d561-4dc7-af07-82e45f79cd3e req-553850ea-3c9b-4c88-88a3-46a6213b32fa service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:21.457965 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-5d3d0494-d561-4dc7-af07-82e45f79cd3e req-553850ea-3c9b-4c88-88a3-46a6213b32fa service nova] Creating event network-vif-deleted:78e188e5-15c6-4fc3-9c8c-7f0ec3763fc6 for instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf on hv-cinder-85044 Jul 21 05:49:21.463525 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-5d3d0494-d561-4dc7-af07-82e45f79cd3e req-553850ea-3c9b-4c88-88a3-46a6213b32fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095187 Jul 21 05:49:21.464517 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 227/450] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:49:21.712145 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:21.712942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:21.721279 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:21.721861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:21.722856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:21.723471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:21.861139 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:21.869473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2be7eae2-5664-4c7a-b7ff-18fd644fbc36 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.162223 Jul 21 05:49:21.870076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 224/451] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:21 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:22.223580 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:22.224769 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] [instance: bcfc2e65-4388-4ea5-bce8-f1af904b22bf] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:22.232240 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:22.232700 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:22.233490 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:22.233932 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:22.248037 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.wsgi [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] HTTP exception thrown: Instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf could not be found. Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Request method failure captured: Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: request: GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf HTTP/1.1 Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept: application/json Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Accept-Encoding: identity Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Connection: close Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Length: 0 Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Content-Type: application/json Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Host: 10.222.0.44 Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Openstack-System-Scope: None Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: User-Agent: python-urllib3/1.26.9 Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Auth-Token: gAAAAABi2OgrGUNQ2AMNopZlf3K6OFfrMp72T-b6HXrXkACXVccE1fRK9TswKCIeq9NcZm6AkMjJoRzRfLdx-Z0vnIIs-Wej0MErJrzNdw9Eyi3BxwqjKONE7I5DGgtPoZYLylGCdUmDEwyoMDXHTn6yvBkufsfRVekIgd-49mnE-pa4O04TIjc Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Id: None Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Domain-Name: None Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Identity-Status: Confirmed Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Is-Admin-Project: True Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Id: default Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Domain-Name: Default Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Id: cb4a02ef918f418f9509f0698503f428 Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1220735106 Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Role: member,reader Jul 21 05:49:22.249683 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Roles: member,reader Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cb4a02ef918f418f9509f0698503f428"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cb4a02ef918f418f9509f0698503f428"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cb4a02ef918f418f9509f0698503f428", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cb4a02ef918f418f9509f0698503f428"}]}] Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant: tempest-VolumesSnapshotTestJSON-1220735106 Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Id: cb4a02ef918f418f9509f0698503f428 Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1220735106 Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User: tempest-VolumesSnapshotTestJSON-1220735106-project Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Id: default Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Domain-Name: Default Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Id: 5baede5b70674737ad285b5831e11002 Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: X-User-Name: tempest-VolumesSnapshotTestJSON-1220735106-project Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: method: > Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: exception: Instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf could not be found. Jul 21 05:49:22.251258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: action_args: {'id': 'bcfc2e65-4388-4ea5-bce8-f1af904b22bf'} Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf could not be found. Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:49:22.252160 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf could not be found. Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf could not be found. Jul 21 05:49:22.253732 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: ERROR nova.api.openstack.wsgi Jul 21 05:49:22.255189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] Returning 404 to user: Instance bcfc2e65-4388-4ea5-bce8-f1af904b22bf could not be found. {{(pid=124329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:49:22.255189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-65e3b357-727c-46c5-9d34-0621a68451c9 tempest-VolumesSnapshotTestJSON-1220735106 tempest-VolumesSnapshotTestJSON-1220735106-project] 10.222.0.44 "GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf" status: 404 len: 111 microversion: 2.1 time: 0.034686 Jul 21 05:49:22.255189 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 228/452] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:22 2022] GET /compute/v2.1/servers/bcfc2e65-4388-4ea5-bce8-f1af904b22bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:49:22.889440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:22.890026 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:22.900274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:22.900867 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:22.901988 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:22.902599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:23.042103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:23.050581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-86a076b3-b0e7-440d-8d62-b4ffa91df266 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.167170 Jul 21 05:49:23.051187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 225/453] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:22 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:24.069933 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:24.070512 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:24.079064 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:24.079508 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:24.080261 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:24.080680 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:24.223032 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:24.231348 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b52526f4-cec0-4a24-a2fa-41c0c9830e1a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.167010 Jul 21 05:49:24.231906 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 229/454] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:24 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:25.252692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:25.253673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:25.262554 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:25.263006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:25.264320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:25.264320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:25.279817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:25.639453 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:25.649415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-96fd8ae8-61d2-4408-b6b7-53257fe19eb2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.403266 Jul 21 05:49:25.649989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 226/455] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:25 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:26.670279 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:26.670887 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:26.673569 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:26.679974 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:26.680472 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:26.681404 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:26.681841 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:26.817553 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:26.825865 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-c39b53a7-3b77-479d-b5ad-3fad629f67de tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.159514 Jul 21 05:49:26.826848 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 230/456] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:26 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:27.847180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:27.848153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:27.856915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:27.857359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:27.858114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:27.858539 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:28.005202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:28.013230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-96c83863-7ce4-444e-a671-d1fa56a8ffe8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.172593 Jul 21 05:49:28.013798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 227/457] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:27 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:29.030472 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:29.031096 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:29.037872 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:29.038307 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:29.039069 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:29.039505 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:29.172768 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:29.181647 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-0f35d5e8-9427-4b82-9183-46d2df03175f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.155379 Jul 21 05:49:29.182127 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 231/458] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:29 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:30.203127 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:30.204079 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:30.215457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:30.216201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:30.217451 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:30.218170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:30.351797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:30.360353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-361a4e8d-1e76-4466-8fb1-2b8f4bbbf380 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.163759 Jul 21 05:49:30.361193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 228/459] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:30 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:31.382025 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:31.382988 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:31.394141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:31.394863 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:31.396243 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:31.396948 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:31.542234 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:31.550643 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-3e2dab29-f5b4-492c-97d9-695a7a0b5723 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.175114 Jul 21 05:49:31.551391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 232/460] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:31 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:32.567954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:32.568620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:32.575620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:32.576059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:32.576819 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:32.577249 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:32.709058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:32.717560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7e19c628-acfa-4a87-902e-8d41afec0675 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.154015 Jul 21 05:49:32.718244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 229/461] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:32 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:33.739585 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:33.740384 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:33.748593 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:33.749034 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:33.749782 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:33.750209 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:33.882525 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:33.890966 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-23a08ff7-fdd4-41d4-83a1-4c77596b15b0 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.157874 Jul 21 05:49:33.891573 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 233/462] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:33 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:34.909906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:34.910966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:34.914537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=42 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:34.921305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:34.921677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:34.922445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:34.922868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:35.082144 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:35.090396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c2ab4e3f-87cf-4616-873f-b13bbff3a1b6 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.184986 Jul 21 05:49:35.090934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 230/463] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:34 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:36.118198 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:36.119229 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:36.130258 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:36.130989 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:36.132266 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:36.132971 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:36.266295 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:36.274313 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-938020b0-97fe-4ee0-9899-d7776b90feea tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.162752 Jul 21 05:49:36.274851 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 234/464] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:36 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:37.296087 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:37.297032 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:37.308230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:37.309067 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:37.309852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:37.310286 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:37.440611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:37.448820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7a2231fe-1406-46bc-b2f4-95d755d6273f tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.159231 Jul 21 05:49:37.449401 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 231/465] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:37 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:38.465862 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:38.466541 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:38.473371 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:38.473778 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:38.474533 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:38.474953 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:38.478837 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:38.610113 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:38.618168 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-ec6b5625-37ea-4bb1-a2f4-5cb9c24ea92a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.156320 Jul 21 05:49:38.618758 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 235/466] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:38 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:39.636315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:39.637029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:39.645398 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:39.645850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:39.646595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:39.647471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:39.782617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:39.791203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5c930e8f-63da-4199-bbde-364cda7f99a2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1734 microversion: 2.1 time: 0.159463 Jul 21 05:49:39.791767 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 232/467] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:39 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:40.809916 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:40.810670 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:40.817626 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:40.818107 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:40.818834 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:40.819281 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:40.954218 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:40.962715 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-604215a9-46d9-4bf8-bd12-f102008e5f2a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1714 microversion: 2.1 time: 0.156478 Jul 21 05:49:40.963350 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 236/468] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:40 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:41.019652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:41.020200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:41.026717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:41.027209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:41.028064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:41.028491 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:41.114341 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] HTTP exception thrown: Cannot 'detach_volume' instance c66ebf62-cfee-40f4-a957-c099e662d2b4 while it is in vm_state rescued Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Request method failure captured: Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments/8ba79229-9d39-4806-983b-c9ca8e08041b HTTP/1.1 Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeXMcQ0_o_qNTRQI8g9PtwmJ007UFL6IYF9l9vbUrWDLUgcQJj7mVw3W14vR_5GZz8pM4fJcbJQXqjv8M9QNmTuy-gyqIA6TliEbT8WOu-hYGhrVyV0uiuiBGzy0rlGCOM3VX9CJaKvzaECcKkijJBw5sEPTQ-J93NtHN4IM3JC0Gs Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:49:41.116016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_da2259120cca423686fd6e54d0ad2257", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}] Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 563f1367093e493bae87a21374a3c2f3 Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:49:41.117478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Cannot 'detach_volume' instance c66ebf62-cfee-40f4-a957-c099e662d2b4 while it is in vm_state rescued Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'server_id': 'c66ebf62-cfee-40f4-a957-c099e662d2b4', 'id': '8ba79229-9d39-4806-983b-c9ca8e08041b'} Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c66ebf62-cfee-40f4-a957-c099e662d2b4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:49:41.118355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c66ebf62-cfee-40f4-a957-c099e662d2b4 while it is in vm_state rescued Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c66ebf62-cfee-40f4-a957-c099e662d2b4 while it is in vm_state rescued Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:49:41.119908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Returning 409 to user: Cannot 'detach_volume' instance c66ebf62-cfee-40f4-a957-c099e662d2b4 while it is in vm_state rescued {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:49:41.121198 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3a3aaed6-354d-4f84-b77d-faf6b9e8d560 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments/8ba79229-9d39-4806-983b-c9ca8e08041b" status: 409 len: 152 microversion: 2.1 time: 0.101939 Jul 21 05:49:41.121198 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 233/469] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 05:49:41 2022] DELETE /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments/8ba79229-9d39-4806-983b-c9ca8e08041b => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 05:49:41.127050 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-d597865b-1d05-43bf-8b77-aa7470589398 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:49:41.127641 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-d597865b-1d05-43bf-8b77-aa7470589398 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:41.133998 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d597865b-1d05-43bf-8b77-aa7470589398 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:41.134441 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d597865b-1d05-43bf-8b77-aa7470589398 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:41.135233 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d597865b-1d05-43bf-8b77-aa7470589398 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:41.135661 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-d597865b-1d05-43bf-8b77-aa7470589398 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:41.202941 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-d597865b-1d05-43bf-8b77-aa7470589398 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "POST /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/action" status: 202 len: 0 microversion: 2.1 time: 0.079685 Jul 21 05:49:41.203618 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 237/470] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:49:41 2022] POST /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:49:41.212835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:41.213456 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:41.222842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:41.223337 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:41.224820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:41.225325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:41.439804 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:41.449328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f82b2ff7-01b3-489a-bac8-c763cf951d06 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1722 microversion: 2.1 time: 0.240589 Jul 21 05:49:41.449908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 234/471] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:41 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:42.469103 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:42.470051 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:42.476925 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:42.477369 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:42.478109 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:42.478594 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:42.608494 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:42.616892 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-fcd329bf-e792-4516-ab70-eeaeba7581bc tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1722 microversion: 2.1 time: 0.153217 Jul 21 05:49:42.617463 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 238/472] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:42 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:43.634942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:43.635598 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:43.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:43.642867 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:43.643661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:43.644125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:43.785655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:43.794028 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9c9de408-421e-4957-ba97-91492ad86725 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1722 microversion: 2.1 time: 0.163218 Jul 21 05:49:43.794797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 235/473] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:43 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:44.814727 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:44.815358 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:44.824181 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:44.824756 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:44.825812 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:44.826364 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:44.966269 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:44.974633 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5651ebb7-e50b-4893-962e-b1248acff506 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1722 microversion: 2.1 time: 0.165293 Jul 21 05:49:44.983146 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 239/474] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:44 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:45.996704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:45.997699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:46.008654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:46.009383 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:46.010639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:46.011443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:46.147919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:49:46.156184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f05813cc-9e6e-437c-b432-c31f1dfac276 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1728 microversion: 2.1 time: 0.166091 Jul 21 05:49:46.156871 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 236/475] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:49:45 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:49:46.176251 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-b2ce9ac1-bad7-4abf-a592-42221702ef6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:49:46.176774 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-b2ce9ac1-bad7-4abf-a592-42221702ef6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:49:46.186893 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b2ce9ac1-bad7-4abf-a592-42221702ef6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:46.187721 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b2ce9ac1-bad7-4abf-a592-42221702ef6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:46.188514 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b2ce9ac1-bad7-4abf-a592-42221702ef6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:46.188942 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-b2ce9ac1-bad7-4abf-a592-42221702ef6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:46.278274 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-b2ce9ac1-bad7-4abf-a592-42221702ef6b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108046 Jul 21 05:49:46.279120 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 240/476] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 05:49:46 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:49:47.158409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-dcaf2ff9-d339-4711-b29f-33c14f2c7a4e req-217668ee-f07a-4146-82da-115ac6de4d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66ebf62-cfee-40f4-a957-c099e662d2b4", "tag": "99521012-321d-4cf5-8d32-bf5aa75214ed"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:49:47.168282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-dcaf2ff9-d339-4711-b29f-33c14f2c7a4e req-217668ee-f07a-4146-82da-115ac6de4d34 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:47.168865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-dcaf2ff9-d339-4711-b29f-33c14f2c7a4e req-217668ee-f07a-4146-82da-115ac6de4d34 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:47.181687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-dcaf2ff9-d339-4711-b29f-33c14f2c7a4e req-217668ee-f07a-4146-82da-115ac6de4d34 service nova] Creating event network-changed:99521012-321d-4cf5-8d32-bf5aa75214ed for instance c66ebf62-cfee-40f4-a957-c099e662d2b4 on hv-cinder-85044 Jul 21 05:49:47.186917 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-dcaf2ff9-d339-4711-b29f-33c14f2c7a4e req-217668ee-f07a-4146-82da-115ac6de4d34 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032910 Jul 21 05:49:47.187627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 237/477] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:49:49.208293 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-124b1348-ff40-4a0f-baf9-b1dfaee18f87 req-bbc7ff4f-3d60-4c2a-a9cd-6ab07c13b536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c66ebf62-cfee-40f4-a957-c099e662d2b4", "tag": "99521012-321d-4cf5-8d32-bf5aa75214ed"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:49:49.217513 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-124b1348-ff40-4a0f-baf9-b1dfaee18f87 req-bbc7ff4f-3d60-4c2a-a9cd-6ab07c13b536 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:49:49.218035 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-124b1348-ff40-4a0f-baf9-b1dfaee18f87 req-bbc7ff4f-3d60-4c2a-a9cd-6ab07c13b536 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:49:49.229740 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-124b1348-ff40-4a0f-baf9-b1dfaee18f87 req-bbc7ff4f-3d60-4c2a-a9cd-6ab07c13b536 service nova] Creating event network-changed:99521012-321d-4cf5-8d32-bf5aa75214ed for instance c66ebf62-cfee-40f4-a957-c099e662d2b4 on hv-cinder-85044 Jul 21 05:49:49.235058 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-124b1348-ff40-4a0f-baf9-b1dfaee18f87 req-bbc7ff4f-3d60-4c2a-a9cd-6ab07c13b536 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033387 Jul 21 05:49:49.235642 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 241/478] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:49:58.889549 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=15 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:58.891027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=65 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:49:59.074286 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6c45c60e-c984-42c5-ba3c-c164bf2b65c5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Action: 'create', calling method: .version_select at 0x7f50903dfa60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-179865322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgerStLk2iJ1cH5A8q/qjYxT0O8BGzqlPgTqkk3gUqFC4hbj2Cu+4ACr9awdwPQQ2QV9EBuNNKDVx2yZwJSiGNkUrAmKQg7MYmzSoSvztKAEPUPCOYxE50Y/b9UqTACjA=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:49:59.088493 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-6c45c60e-c984-42c5-ba3c-c164bf2b65c5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:49:59.092576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-6c45c60e-c984-42c5-ba3c-c164bf2b65c5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for user 17108265cfba44b29c362ac18bbf3e20 and project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:49:59.116136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6c45c60e-c984-42c5-ba3c-c164bf2b65c5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.231935 Jul 21 05:49:59.116740 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 238/479] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 05:49:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:50:03.831945 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f5ad1bbe-4bd8-4f12-80f5-40359149e668 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:50:03.832919 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f5ad1bbe-4bd8-4f12-80f5-40359149e668 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:03.835373 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_api:SELECT=23 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:03.836000 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG dbcounter [-] [124329] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:03.845749 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f5ad1bbe-4bd8-4f12-80f5-40359149e668 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:03.846270 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f5ad1bbe-4bd8-4f12-80f5-40359149e668 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:03.847039 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f5ad1bbe-4bd8-4f12-80f5-40359149e668 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:03.847483 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f5ad1bbe-4bd8-4f12-80f5-40359149e668 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:03.928175 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f5ad1bbe-4bd8-4f12-80f5-40359149e668 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/action" status: 202 len: 0 microversion: 2.1 time: 0.100552 Jul 21 05:50:03.928882 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 242/480] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:50:03 2022] POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:50:03.938423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:03.940274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:03.947483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:03.947923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:03.948686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:03.949110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:04.393944 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:04.402746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3ea2c29b-215f-4097-8ab9-4b3275e6720b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1751 microversion: 2.1 time: 0.469292 Jul 21 05:50:04.403578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 239/481] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:03 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1751 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:05.425717 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:05.426391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:05.434001 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:05.434528 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:05.435407 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:05.435846 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:05.588587 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:05.596913 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f6d05f52-960b-47f2-8578-f18c5e04a208 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.177521 Jul 21 05:50:05.597477 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 243/482] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:05 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:06.616236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:06.616872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:06.623959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:06.624395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:06.625162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:06.625591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:06.780582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:06.789894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c3574b43-da64-4f9f-bfdc-a74f9f998462 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.177551 Jul 21 05:50:06.790475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 240/483] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:06 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:07.809980 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:07.810627 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:07.818049 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:07.818504 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:07.819286 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:07.819709 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:07.967218 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:07.975460 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-5ebd6046-664a-4104-9e4c-4edb790525bd tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.169524 Jul 21 05:50:07.975993 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 244/484] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:07 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:08.994822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:08.995464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:09.002425 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:09.002858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:09.003660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:09.004063 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:09.099938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:09.158208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:09.166676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-814cb653-e23c-466e-9acc-340325d31bf0 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.175786 Jul 21 05:50:09.167337 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 241/485] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:08 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:10.185517 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:10.186453 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:10.195117 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:10.195562 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:10.196336 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:10.196751 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:10.350371 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:10.358516 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-cfe7d994-67eb-409a-affa-23bc10366def tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.177588 Jul 21 05:50:10.359116 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 245/486] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:10 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:11.377233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:11.377874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:11.386949 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:11.387691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:11.389066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:11.389568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:11.594684 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:11.604117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-381a589a-77a7-47fc-b8e5-39fffa0ea4d8 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.230687 Jul 21 05:50:11.604809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 242/487] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:11 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:12.622143 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:12.622800 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:12.629805 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:12.630247 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:12.631042 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:12.631473 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:12.777727 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:12.786066 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-6f47eba2-7c0c-4cba-bcb6-b207431c6f68 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.167866 Jul 21 05:50:12.786620 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 246/488] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:12 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:13.811470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:13.812162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:13.820906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:13.821344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:13.822150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:13.822574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:13.969998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:13.980924 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8e717307-9961-4dcf-9e69-69867c8ed732 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.176048 Jul 21 05:50:13.981493 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 243/489] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:13 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:14.998502 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:14.999092 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:15.006107 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:15.006551 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:15.007342 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:15.007770 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:15.158797 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:15.167777 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-925bf962-d419-42de-9611-0775e6cfaeeb tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.173266 Jul 21 05:50:15.168323 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 247/490] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:14 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:16.192472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:16.193289 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:16.200788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:16.201226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:16.201982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:16.202403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:16.354712 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:16.362636 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4220fa09-33b7-4ce9-91a2-fb2eca99bbb7 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.175805 Jul 21 05:50:16.363230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 244/491] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:16 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:17.380268 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:17.380896 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:17.388349 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:17.388784 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:17.389534 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:17.389952 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:17.531263 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:17.542475 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-f16fb8f2-1b50-49d3-8835-87fc13bc396d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.166114 Jul 21 05:50:17.543043 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 248/492] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:17 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:18.565029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:18.566052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:18.576845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:18.577576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:18.578813 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:18.579564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:18.733474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:18.742422 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e18b53aa-9aba-411f-8510-042e084a48d4 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.184942 Jul 21 05:50:18.742992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 245/493] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:18 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:19.763838 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:19.764662 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:19.775678 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:19.776393 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:19.777663 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:19.778380 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:19.935365 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:19.946624 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-76c6f28c-2d20-4395-83dc-df5a43a7f549 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.189646 Jul 21 05:50:19.947207 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 249/494] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:19 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:20.968436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:20.969490 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:20.980747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:20.981489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:20.982735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:20.983502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:21.127845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:21.137677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dd7c1814-d5d5-4f33-bba1-4fdfa4f98775 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1756 microversion: 2.1 time: 0.175835 Jul 21 05:50:21.138244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 246/495] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:20 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:22.159368 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:22.160388 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:22.168583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:22.169023 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:22.169777 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:22.170205 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:22.320098 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:22.332343 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-3b8b4997-90dc-4005-8958-31e0bea3e285 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1759 microversion: 2.1 time: 0.179434 Jul 21 05:50:22.333100 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 250/496] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:22 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:23.928779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e40032e9-7b39-4602-a30b-1e71a08c5886 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:23.929409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e40032e9-7b39-4602-a30b-1e71a08c5886 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:23.935967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40032e9-7b39-4602-a30b-1e71a08c5886 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:23.936405 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40032e9-7b39-4602-a30b-1e71a08c5886 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:23.937148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40032e9-7b39-4602-a30b-1e71a08c5886 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:23.937568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40032e9-7b39-4602-a30b-1e71a08c5886 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:23.966786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e40032e9-7b39-4602-a30b-1e71a08c5886 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments/8ea9443b-7652-4739-96d6-33d622471ed6" status: 200 len: 194 microversion: 2.20 time: 0.042189 Jul 21 05:50:23.967389 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 247/497] 10.222.0.44 () {60 vars in 1453 bytes} [Thu Jul 21 05:50:23 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments/8ea9443b-7652-4739-96d6-33d622471ed6 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:50:24.036805 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:24.037525 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:24.046943 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:24.047544 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:24.048718 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:24.049344 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:24.133339 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.objects.instance [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lazy-loading 'services' on Instance uuid 82c3106a-0a81-4575-b1a7-dc0fc54551e2 {{(pid=124329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:50:24.209804 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-993f3065-b7d2-48fb-9ecf-8eb1eeafdf6b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments/8ea9443b-7652-4739-96d6-33d622471ed6" status: 202 len: 0 microversion: 2.20 time: 0.180048 Jul 21 05:50:24.210766 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 251/498] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jul 21 05:50:24 2022] DELETE /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments/8ea9443b-7652-4739-96d6-33d622471ed6 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:50:24.221090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f897e457-2765-4556-9e85-1479d1c37370 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:24.222011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f897e457-2765-4556-9e85-1479d1c37370 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:24.228622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f897e457-2765-4556-9e85-1479d1c37370 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:24.229063 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f897e457-2765-4556-9e85-1479d1c37370 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:24.229821 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f897e457-2765-4556-9e85-1479d1c37370 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:24.230272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f897e457-2765-4556-9e85-1479d1c37370 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:24.260248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f897e457-2765-4556-9e85-1479d1c37370 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043072 Jul 21 05:50:24.260830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 248/499] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jul 21 05:50:24 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:50:24.873208 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-575457427", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-179865322", "security_groups": [{"name": "tempest-secgroup-smoke-1102999197"}], "block_device_mapping_v2": [{"uuid": "0afdc9cd-f33c-429e-8b01-f8b59eb69213", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d24dd506-b76c-4cd5-b8bb-2127b1812879"}]}} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:50:25.006609 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.network.neutron [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] validate_networks() for [('d24dd506-b76c-4cd5-b8bb-2127b1812879', None, None, None, None, None)] {{(pid=124329) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:50:25.274999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8340b9d7-7bcd-4e23-9ed0-c8d4f7591ae7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:25.276068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8340b9d7-7bcd-4e23-9ed0-c8d4f7591ae7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:25.285416 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8340b9d7-7bcd-4e23-9ed0-c8d4f7591ae7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.285954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8340b9d7-7bcd-4e23-9ed0-c8d4f7591ae7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.286921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8340b9d7-7bcd-4e23-9ed0-c8d4f7591ae7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.287234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8340b9d7-7bcd-4e23-9ed0-c8d4f7591ae7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.321209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8340b9d7-7bcd-4e23-9ed0-c8d4f7591ae7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051740 Jul 21 05:50:25.325517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 249/500] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jul 21 05:50:25 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:25.381533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:25.382204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:25.388388 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.388833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.389598 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.390029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.417382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:50:25.498316 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bcbc4d15-c4e9-485a-9eaa-c649ab241485 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 204 len: 0 microversion: 2.20 time: 0.120397 Jul 21 05:50:25.499069 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 250/501] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 05:50:25 2022] DELETE /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 05:50:25.504469 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Flavor limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:50:25.504973 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Image limits 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:50:25.505473 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Flavor pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:50:25.505935 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Image pref 0:0:0 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:50:25.506434 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.virt.hardware [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:50:25.507499 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:25.508325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:25.514210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.514650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.515443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.515868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.517765 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.518214 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.519046 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:25.519472 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:25.536783 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:50:25.540819 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.quota [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for user 17108265cfba44b29c362ac18bbf3e20 and project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'cores', 'instances', 'ram'} {{(pid=124329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:50:25.558904 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Traceback (most recent call last): Jul 21 05:50:25.559141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 21 05:50:25.559141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: timer() Jul 21 05:50:25.559141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 21 05:50:25.559141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: cb(*args, **kw) Jul 21 05:50:25.559141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 21 05:50:25.559141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: waiter.switch() Jul 21 05:50:25.559141 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: greenlet.error: cannot switch to a different thread Jul 21 05:50:25.618217 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Going to run 1 instances... {{(pid=124329) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:50:25.620464 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0afdc9cd-f33c-429e-8b01-f8b59eb69213',volume_size=None,volume_type=None)] {{(pid=124329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:50:25.650336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:25.658910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:25.660444 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:25.661792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9b820e6c-a0cc-43e7-8384-860984a67a92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.158568 Jul 21 05:50:25.662805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 251/502] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:50:25 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:50:25.772737 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-49210da9-b92f-41fd-9a56-5e9ba710b3d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.903626 Jul 21 05:50:25.773298 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 252/503] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:50:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:50:25.783793 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d88bf39c-4b34-4579-a3e4-f6b74fe55e12 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:25.784587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d88bf39c-4b34-4579-a3e4-f6b74fe55e12 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:25.842220 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d88bf39c-4b34-4579-a3e4-f6b74fe55e12 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:25.848911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d88bf39c-4b34-4579-a3e4-f6b74fe55e12 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1093 microversion: 2.1 time: 0.069448 Jul 21 05:50:25.849490 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 252/504] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:25 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:26.684574 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:26.685208 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:26.695504 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:26.695940 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:26.696689 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:26.697114 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:26.833848 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:26.842712 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:26.844255 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:26.845418 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-83e19166-858d-417d-99c1-52e943ce0e92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.167595 Jul 21 05:50:26.845973 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 253/505] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:50:26 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:50:26.865732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:26.866393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:26.875162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:26.875612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:26.876384 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:26.876822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:26.939044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:26.946876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e40bfb25-bc57-4703-9370-033510b842c6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1143 microversion: 2.1 time: 0.085018 Jul 21 05:50:26.947477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 253/506] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:26 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:27.864760 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:27.865618 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:27.873923 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:27.874601 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:27.875496 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:27.876150 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:27.963887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:27.964502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:27.971337 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:27.971791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:27.972530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:27.973183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:28.123919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:28.127604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:28.132486 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-901756bc-5d31-4425-974f-bab0fc4bb2e5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1199 microversion: 2.1 time: 0.172688 Jul 21 05:50:28.133031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 254/507] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:27 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1199 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:28.209409 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:28.217605 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:28.219271 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:28.220521 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-749fb67a-8a90-4478-951e-1104289cc0c5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1722 microversion: 2.20 time: 0.360180 Jul 21 05:50:28.221175 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 254/508] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:50:27 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:50:29.150282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:29.150851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:29.153296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:29.159678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:29.160101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:29.160868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:29.161300 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:29.239831 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:29.240392 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.compute.api [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124329) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:29.247161 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:29.247614 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:29.248451 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:29.248797 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:29.598087 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:29.614199 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:29.616634 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.policy [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124329) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:29.618014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [None req-106dbf36-cb5d-4653-b4d0-8123508cf860 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 200 len: 1655 microversion: 2.20 time: 0.382218 Jul 21 05:50:29.618778 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 255/509] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:50:29 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 1655 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:50:29.762580 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [req-a8a079ad-0397-4fc4-ba7b-e08a5b84945c req-7636356c-0239-4dd8-be34-b8b4c3c78f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82c3106a-0a81-4575-b1a7-dc0fc54551e2", "name": "network-vif-deleted", "tag": "38bd4456-0aed-49a5-99eb-1bfcf154ecc0"}]} {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:50:29.781088 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:29.787583 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-a8a079ad-0397-4fc4-ba7b-e08a5b84945c req-7636356c-0239-4dd8-be34-b8b4c3c78f39 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:29.788280 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG oslo_concurrency.lockutils [req-a8a079ad-0397-4fc4-ba7b-e08a5b84945c req-7636356c-0239-4dd8-be34-b8b4c3c78f39 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:29.803543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6730f546-6c34-408a-af08-3322cc18eb98 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.649848 Jul 21 05:50:29.809100 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.compute.server_external_events [req-a8a079ad-0397-4fc4-ba7b-e08a5b84945c req-7636356c-0239-4dd8-be34-b8b4c3c78f39 service nova] Creating event network-vif-deleted:38bd4456-0aed-49a5-99eb-1bfcf154ecc0 for instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 on hv-cinder-85044 Jul 21 05:50:29.811483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 255/510] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:29 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:29.821646 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO nova.api.openstack.requestlog [req-a8a079ad-0397-4fc4-ba7b-e08a5b84945c req-7636356c-0239-4dd8-be34-b8b4c3c78f39 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063768 Jul 21 05:50:29.822671 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: [pid: 124329|app: 0|req: 256/511] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:50:30.639162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:30.640092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:30.649104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:30.655938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:30.658723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:30.660199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:30.694124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] HTTP exception thrown: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Request method failure captured: Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 HTTP/1.1 Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeQr7ilklxZ9XqEg2x4ZcdVVlTUWztj5xvGpcm-0b3q5k0T7LITkLgfWEsVMxMhV64gCotdUqdVay0zre1IAbf2Uljg9gEsjsBCY0P_VUF6XmJN1nf404Mlr7aIuojjO-r8whgS3LPTETOZr-n5BYb_nODVbh7XsMBKt83pjp4XLMU Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:50:30.696029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7b88b7408762493e825c86d05b5e62bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}] Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 0cbf797171144c139c72c516cea59bb9 Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:50:30.697644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '82c3106a-0a81-4575-b1a7-dc0fc54551e2'} Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:50:30.698467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:50:30.700715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:50:30.702786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Returning 404 to user: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:50:30.702786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6e8159d1-7e2b-4f5d-ba03-0a0c11a26e38 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 404 len: 111 microversion: 2.20 time: 0.064058 Jul 21 05:50:30.702786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 256/512] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:50:30 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 05:50:30.709062 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: DEBUG nova.api.openstack.wsgi [None req-047d8268-2b2b-407b-8bae-604a0bb1c95f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '.version_select at 0x7f50910a88b0>' {{(pid=124329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:30.827035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:30.827685 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:30.835756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:30.836200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:30.837696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:30.838067 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:31.089371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:31.097253 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-66730bd6-01a5-41ee-9943-6ddb14b21ca8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.274410 Jul 21 05:50:31.098121 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 257/513] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:30 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:31.838274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-200a114b-f2e9-430e-9303-a6c3f4294ff3 req-0afd4fed-32c9-4967-bad6-bc957680b0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119674ff-e339-4ec5-9d00-18ad40d627c3", "tag": "b45347c6-78c0-44d3-8334-be006a63c355"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:50:31.848062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-200a114b-f2e9-430e-9303-a6c3f4294ff3 req-0afd4fed-32c9-4967-bad6-bc957680b0cf service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:31.848545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-200a114b-f2e9-430e-9303-a6c3f4294ff3 req-0afd4fed-32c9-4967-bad6-bc957680b0cf service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:31.859883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-200a114b-f2e9-430e-9303-a6c3f4294ff3 req-0afd4fed-32c9-4967-bad6-bc957680b0cf service nova] Creating event network-changed:b45347c6-78c0-44d3-8334-be006a63c355 for instance 119674ff-e339-4ec5-9d00-18ad40d627c3 on hv-cinder-85044 Jul 21 05:50:31.864970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-200a114b-f2e9-430e-9303-a6c3f4294ff3 req-0afd4fed-32c9-4967-bad6-bc957680b0cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Jul 21 05:50:31.865545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 258/514] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:50:32.120938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:32.121679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:32.128647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:32.129114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:32.129886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:32.130325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:32.345324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:32.353338 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a5b4742f-1493-46ca-8f74-40b26c9e26f8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.238460 Jul 21 05:50:32.354123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 259/515] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:32 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:33.377129 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:33.378209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:33.386508 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:33.386937 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:33.387719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:33.388140 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:33.529935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:33.538363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0761fc40-30f4-47a5-a63e-19dabb08c67f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.167779 Jul 21 05:50:33.538926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 260/516] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:33 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:34.559533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:34.560585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:34.572396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:34.573248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:34.574504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:34.575288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:34.722150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:34.730092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2efb08ce-0d3f-4f02-8231-82e31db93230 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.177695 Jul 21 05:50:34.730655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 261/517] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:34 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:35.751051 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:35.752106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:35.763385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:35.764124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:35.765364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:35.766073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:35.846360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:35.908076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:35.915617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-27476892-ba5e-4993-ad8e-cc65ac961fe4 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.171045 Jul 21 05:50:35.916207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 262/518] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:35 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:36.936918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:36.938017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:36.947378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:36.947825 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:36.948577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:36.949003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:37.086234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:37.094470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1e5f4323-38a0-45cc-bd8b-64413a2c1033 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.164194 Jul 21 05:50:37.095046 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 263/519] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:36 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:38.115860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:38.116872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:38.124840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:38.125394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:38.126259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:38.126764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:38.262079 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:38.270157 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7d537a23-148c-4c1b-80de-5d85a23e825d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.160983 Jul 21 05:50:38.270719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 264/520] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:38 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:39.291252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:39.291981 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:39.299891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:39.300421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:39.301312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:39.301815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:39.433525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:39.441517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4d815a08-4e5e-4fd3-99c4-b6e90f5057d0 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.156098 Jul 21 05:50:39.442104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 265/521] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:39 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:40.458694 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:40.459434 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:40.465983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:40.466429 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:40.467213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:40.467663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:40.615178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:40.625136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-581e1e30-82b1-4f6a-ae06-a7ed1192c044 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.170117 Jul 21 05:50:40.625964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 266/522] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:40 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:50:41.645707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:41.653733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:41.657750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:41.658200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:41.658959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:41.659669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:41.795148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:41.803263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5a52ec4c-74f8-4555-a82d-c33d81f90277 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.162136 Jul 21 05:50:41.812361 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 267/523] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:41 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:41.867672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-7e4b9d02-5440-4249-b106-fa7f9a4c2c1c req-7b816477-5dd3-4adc-83f1-4e9b85130545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119674ff-e339-4ec5-9d00-18ad40d627c3", "name": "network-vif-plugged", "status": "completed", "tag": "b45347c6-78c0-44d3-8334-be006a63c355"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:50:41.875786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-7e4b9d02-5440-4249-b106-fa7f9a4c2c1c req-7b816477-5dd3-4adc-83f1-4e9b85130545 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:41.876224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-7e4b9d02-5440-4249-b106-fa7f9a4c2c1c req-7b816477-5dd3-4adc-83f1-4e9b85130545 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:41.887427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-7e4b9d02-5440-4249-b106-fa7f9a4c2c1c req-7b816477-5dd3-4adc-83f1-4e9b85130545 service nova] Creating event network-vif-plugged:b45347c6-78c0-44d3-8334-be006a63c355 for instance 119674ff-e339-4ec5-9d00-18ad40d627c3 on hv-cinder-85044 Jul 21 05:50:41.892676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-7e4b9d02-5440-4249-b106-fa7f9a4c2c1c req-7b816477-5dd3-4adc-83f1-4e9b85130545 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087595 Jul 21 05:50:41.893570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 268/524] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:50:42.825706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:42.826906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:42.836748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:42.837222 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:42.837977 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:42.838406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:42.970103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:42.978369 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ffed45a8-e688-4496-8b07-f635d203385e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.160552 Jul 21 05:50:42.978939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 269/525] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:42 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:43.996549 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:43.997223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:44.004320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:44.004757 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:44.005514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:44.005943 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:44.145061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:44.153617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5b390916-3268-4546-87b0-2a7fe639c432 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1265 microversion: 2.1 time: 0.161134 Jul 21 05:50:44.154185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 270/526] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:43 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:45.174830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:45.175939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:45.186967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:45.187798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:45.189061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:45.189779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:45.331995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:45.343442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-abb29005-058a-48b3-a71d-a4d9de9e7989 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1452 microversion: 2.1 time: 0.174807 Jul 21 05:50:45.344196 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 271/527] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:45 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:45.359140 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:45.359743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:45.365658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:45.366149 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:45.366940 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:45.367409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:45.510955 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:45.522551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-eb61c13b-937a-48f4-8ac8-71c64b7463dc tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1452 microversion: 2.1 time: 0.166500 Jul 21 05:50:45.523116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 272/528] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:45 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:50:47.245764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-31225312-0baa-458b-8231-485fc919f0e3 req-693b8e7b-edb5-4e64-bf37-eaa9ffd1d3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119674ff-e339-4ec5-9d00-18ad40d627c3", "tag": "b45347c6-78c0-44d3-8334-be006a63c355"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:50:47.254163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-31225312-0baa-458b-8231-485fc919f0e3 req-693b8e7b-edb5-4e64-bf37-eaa9ffd1d3d1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:47.254638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-31225312-0baa-458b-8231-485fc919f0e3 req-693b8e7b-edb5-4e64-bf37-eaa9ffd1d3d1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:47.266188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-31225312-0baa-458b-8231-485fc919f0e3 req-693b8e7b-edb5-4e64-bf37-eaa9ffd1d3d1 service nova] Creating event network-changed:b45347c6-78c0-44d3-8334-be006a63c355 for instance 119674ff-e339-4ec5-9d00-18ad40d627c3 on hv-cinder-85044 Jul 21 05:50:47.271378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-31225312-0baa-458b-8231-485fc919f0e3 req-693b8e7b-edb5-4e64-bf37-eaa9ffd1d3d1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029288 Jul 21 05:50:47.272072 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 273/529] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:50:53.621720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:53.622428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:53.628711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:53.629157 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:53.629922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:53.630352 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:53.634378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:53.714995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lazy-loading 'services' on Instance uuid c66ebf62-cfee-40f4-a957-c099e662d2b4 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:50:53.798935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fb1be0ce-9e8e-4d40-92b6-e745e9c9f121 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments/8ba79229-9d39-4806-983b-c9ca8e08041b" status: 202 len: 0 microversion: 2.1 time: 0.182059 Jul 21 05:50:53.799951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 274/530] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 05:50:53 2022] DELETE /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments/8ba79229-9d39-4806-983b-c9ca8e08041b => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 05:50:53.809721 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7a0f7f1c-b784-4748-803b-b2d41ee578f7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:53.810797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7a0f7f1c-b784-4748-803b-b2d41ee578f7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:53.817717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a0f7f1c-b784-4748-803b-b2d41ee578f7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:53.818216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a0f7f1c-b784-4748-803b-b2d41ee578f7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:53.819194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a0f7f1c-b784-4748-803b-b2d41ee578f7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:53.819751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a0f7f1c-b784-4748-803b-b2d41ee578f7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:53.855558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7a0f7f1c-b784-4748-803b-b2d41ee578f7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050569 Jul 21 05:50:53.856032 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 275/531] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 05:50:53 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:50:54.869707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-07b5818b-9bda-46ee-9c1e-49ccc461a6f2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:54.871128 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-07b5818b-9bda-46ee-9c1e-49ccc461a6f2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:54.877815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-07b5818b-9bda-46ee-9c1e-49ccc461a6f2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:54.878263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-07b5818b-9bda-46ee-9c1e-49ccc461a6f2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:54.879049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-07b5818b-9bda-46ee-9c1e-49ccc461a6f2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:54.879487 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-07b5818b-9bda-46ee-9c1e-49ccc461a6f2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:54.908796 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-07b5818b-9bda-46ee-9c1e-49ccc461a6f2 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044276 Jul 21 05:50:54.909330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 276/532] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 05:50:54 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 05:50:54.979504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:54.979991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:54.986336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:54.986777 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:54.987524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:54.987950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:55.012638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:50:55.098042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-83c6e1ce-3452-4a6a-999e-343f9b208fde tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 204 len: 0 microversion: 2.1 time: 0.122105 Jul 21 05:50:55.098650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 277/533] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:50:54 2022] DELETE /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 05:50:55.108696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:55.109381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:55.115201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:55.115637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:55.116391 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:55.116815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:55.269795 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:55.277833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0d7bdf20-708e-498c-af88-23a3117317a1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1688 microversion: 2.1 time: 0.174407 Jul 21 05:50:55.278393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 278/534] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:55 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:50:56.297493 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:56.298396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:56.309331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:56.309935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:56.311077 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:56.311569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:56.451883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:56.460033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4261bfe8-a431-4b42-9eb7-70740b5d61eb tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1688 microversion: 2.1 time: 0.167867 Jul 21 05:50:56.460577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 279/535] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:56 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:57.482979 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:57.483610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:57.490362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:57.490809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:57.491678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:57.492109 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:57.624893 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:57.636359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6c1ce17b-35e3-4edb-9b3a-4dee245e5172 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1688 microversion: 2.1 time: 0.157174 Jul 21 05:50:57.637088 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 280/536] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:57 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:58.663387 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:58.664418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:58.671942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:58.672388 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:58.673157 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:58.673596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:58.815137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:58.823240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0da98b72-bbd8-4830-8240-445331ee2290 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1688 microversion: 2.1 time: 0.166922 Jul 21 05:50:58.823808 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 281/537] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:58 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:59.841500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:50:59.842164 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:50:59.846691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:50:59.850867 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:59.852104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:59.853246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:59.853862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:59.934207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:50:59.947627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d9d0951a-0374-4e9a-a02b-474d84993be8 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 200 len: 1621 microversion: 2.1 time: 0.110730 Jul 21 05:50:59.948522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 282/538] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:50:59 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 1621 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:50:59.953626 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-ae3b330c-66d8-4cb3-a377-754d7e21fd55 req-bf78b12a-60a5-4fa6-a498-a9ecbc3ce46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c66ebf62-cfee-40f4-a957-c099e662d2b4", "name": "network-vif-deleted", "tag": "99521012-321d-4cf5-8d32-bf5aa75214ed"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:50:59.962611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-ae3b330c-66d8-4cb3-a377-754d7e21fd55 req-bf78b12a-60a5-4fa6-a498-a9ecbc3ce46b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:50:59.963213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-ae3b330c-66d8-4cb3-a377-754d7e21fd55 req-bf78b12a-60a5-4fa6-a498-a9ecbc3ce46b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:50:59.976685 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-ae3b330c-66d8-4cb3-a377-754d7e21fd55 req-bf78b12a-60a5-4fa6-a498-a9ecbc3ce46b service nova] Creating event network-vif-deleted:99521012-321d-4cf5-8d32-bf5aa75214ed for instance c66ebf62-cfee-40f4-a957-c099e662d2b4 on hv-cinder-85044 Jul 21 05:50:59.984717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-ae3b330c-66d8-4cb3-a377-754d7e21fd55 req-bf78b12a-60a5-4fa6-a498-a9ecbc3ce46b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034848 Jul 21 05:50:59.985695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 283/539] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:00.965598 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:00.966357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: c66ebf62-cfee-40f4-a957-c099e662d2b4] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:00.974391 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:00.974748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:00.975550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:00.975979 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:00.990188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] HTTP exception thrown: Instance c66ebf62-cfee-40f4-a957-c099e662d2b4 could not be found. Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Request method failure captured: Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 HTTP/1.1 Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeXMcQ0_o_qNTRQI8g9PtwmJ007UFL6IYF9l9vbUrWDLUgcQJj7mVw3W14vR_5GZz8pM4fJcbJQXqjv8M9QNmTuy-gyqIA6TliEbT8WOu-hYGhrVyV0uiuiBGzy0rlGCOM3VX9CJaKvzaECcKkijJBw5sEPTQ-J93NtHN4IM3JC0Gs Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:51:00.991897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_da2259120cca423686fd6e54d0ad2257", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}] Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 563f1367093e493bae87a21374a3c2f3 Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance c66ebf62-cfee-40f4-a957-c099e662d2b4 could not be found. Jul 21 05:51:00.993580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'c66ebf62-cfee-40f4-a957-c099e662d2b4'} Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66ebf62-cfee-40f4-a957-c099e662d2b4 could not be found. Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:51:00.994516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66ebf62-cfee-40f4-a957-c099e662d2b4 could not be found. Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66ebf62-cfee-40f4-a957-c099e662d2b4 could not be found. Jul 21 05:51:00.996131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:00.997530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Returning 404 to user: Instance c66ebf62-cfee-40f4-a957-c099e662d2b4 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:51:00.997530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ff5d684f-0fdd-460f-b539-9f20ccf3282b tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4" status: 404 len: 111 microversion: 2.1 time: 0.032222 Jul 21 05:51:00.997530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 284/540] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:00 2022] GET /compute/v2.1/servers/c66ebf62-cfee-40f4-a957-c099e662d2b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:51:01.006521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b5a729e7-ab00-4cf1-a14d-a1d9200acb98 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '.version_select at 0x7f509041f940>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:01.030136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b5a729e7-ab00-4cf1-a14d-a1d9200acb98 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264639962" status: 202 len: 0 microversion: 2.1 time: 0.027086 Jul 21 05:51:01.030879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 285/541] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 05:51:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1264639962 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 05:51:03.940972 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:03.941597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:03.949043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:03.949533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:03.950308 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:03.950741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:03.976743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:51:04.069192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3d2a2808-1ad7-45d8-8041-980ce10b21d1 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "DELETE /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 204 len: 0 microversion: 2.1 time: 0.132620 Jul 21 05:51:04.070103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 286/542] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:51:03 2022] DELETE /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:51:04.078402 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:04.079125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:04.084987 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:04.085425 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:04.086171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:04.086594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:04.221768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:04.233259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5fd75e94-8675-4c62-94fe-723d49b63406 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1506 microversion: 2.1 time: 0.158454 Jul 21 05:51:04.234104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 287/543] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:04 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:05.255384 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:05.256030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:05.263498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:05.263967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:05.264733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:05.265152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:05.482908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:05.490988 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1c9d75fb-1677-48a9-b32c-d4c1d099c20a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 200 len: 1506 microversion: 2.1 time: 0.239428 Jul 21 05:51:05.495149 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 288/544] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:05 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:05.496158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-a7687326-0aea-4a01-be01-51b4a77f1fe2 req-182faeb4-1999-4e58-ab2f-d6e880288298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d7a2a5-58ba-48ea-9f1c-d504463da032", "name": "network-vif-deleted", "tag": "12f5050c-8dc5-4cfd-8048-163c07b6a19f"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:05.504637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a7687326-0aea-4a01-be01-51b4a77f1fe2 req-182faeb4-1999-4e58-ab2f-d6e880288298 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:05.505081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a7687326-0aea-4a01-be01-51b4a77f1fe2 req-182faeb4-1999-4e58-ab2f-d6e880288298 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:05.509518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:05.517610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-a7687326-0aea-4a01-be01-51b4a77f1fe2 req-182faeb4-1999-4e58-ab2f-d6e880288298 service nova] Creating event network-vif-deleted:12f5050c-8dc5-4cfd-8048-163c07b6a19f for instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 on hv-cinder-85044 Jul 21 05:51:05.522616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-a7687326-0aea-4a01-be01-51b4a77f1fe2 req-182faeb4-1999-4e58-ab2f-d6e880288298 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029819 Jul 21 05:51:05.523708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 289/545] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:06.514678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:06.515848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 52d7a2a5-58ba-48ea-9f1c-d504463da032] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:06.527098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:06.527548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:06.528312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:06.528744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:06.542778 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] HTTP exception thrown: Instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 could not be found. Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Request method failure captured: Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 HTTP/1.1 Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeXMcQ0_o_qNTRQI8g9PtwmJ007UFL6IYF9l9vbUrWDLUgcQJj7mVw3W14vR_5GZz8pM4fJcbJQXqjv8M9QNmTuy-gyqIA6TliEbT8WOu-hYGhrVyV0uiuiBGzy0rlGCOM3VX9CJaKvzaECcKkijJBw5sEPTQ-J93NtHN4IM3JC0Gs Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:51:06.544427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_da2259120cca423686fd6e54d0ad2257", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}] Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 563f1367093e493bae87a21374a3c2f3 Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 could not be found. Jul 21 05:51:06.545903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '52d7a2a5-58ba-48ea-9f1c-d504463da032'} Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 could not be found. Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:51:06.546802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 could not be found. Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 could not be found. Jul 21 05:51:06.548366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:06.549932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Returning 404 to user: Instance 52d7a2a5-58ba-48ea-9f1c-d504463da032 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:51:06.549932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9e6f4771-4960-4c42-ac28-3066c99d999c tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032" status: 404 len: 111 microversion: 2.1 time: 0.039545 Jul 21 05:51:06.549932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 290/546] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:06 2022] GET /compute/v2.1/servers/52d7a2a5-58ba-48ea-9f1c-d504463da032 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:51:06.553906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:06.554390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:06.560076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:06.560526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:06.561273 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:06.561704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:06.587987 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:51:06.667114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d65d2fea-f1fe-45f3-b4d6-27a61312d431 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 204 len: 0 microversion: 2.1 time: 0.116206 Jul 21 05:51:06.667790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 291/547] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:51:06 2022] DELETE /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:51:06.677379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:06.678063 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:06.684217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:06.684658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:06.685406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:06.685832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:06.835805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:06.843845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c716eb6a-f3e4-425e-8a26-9dee0edee9fd tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.171499 Jul 21 05:51:06.844412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 292/548] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:06 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:07.865114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:07.865761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:07.872831 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:07.873279 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:07.874033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:07.874461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:08.012480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:08.021947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2d6eec1d-b393-4981-954e-7cd4cf2cead7 tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1520 microversion: 2.1 time: 0.160701 Jul 21 05:51:08.022541 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 293/549] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:07 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:08.815050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-02c011a4-b0fe-4604-a049-dd372dc16234 req-17fb6203-ea5b-4685-a531-4c621a64e7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456", "name": "network-vif-deleted", "tag": "2202ada8-e4b3-4035-bfb8-6abb7d693047"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:08.823419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-02c011a4-b0fe-4604-a049-dd372dc16234 req-17fb6203-ea5b-4685-a531-4c621a64e7ec service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:08.823854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-02c011a4-b0fe-4604-a049-dd372dc16234 req-17fb6203-ea5b-4685-a531-4c621a64e7ec service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:08.835322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-02c011a4-b0fe-4604-a049-dd372dc16234 req-17fb6203-ea5b-4685-a531-4c621a64e7ec service nova] Creating event network-vif-deleted:2202ada8-e4b3-4035-bfb8-6abb7d693047 for instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 on hv-cinder-85044 Jul 21 05:51:08.840222 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-02c011a4-b0fe-4604-a049-dd372dc16234 req-17fb6203-ea5b-4685-a531-4c621a64e7ec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030014 Jul 21 05:51:08.840866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 294/550] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:51:09.045168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:09.045832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:09.052535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:09.052947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:09.053728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:09.054156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:09.086549 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:09.086991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:09.087460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lazy-loading 'fault' on Instance uuid 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:51:09.130173 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '563f1367093e493bae87a21374a3c2f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da2259120cca423686fd6e54d0ad2257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:09.138027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8c271cfa-a0db-40af-bf8a-9917cdc8f67e tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 200 len: 1310 microversion: 2.1 time: 0.098941 Jul 21 05:51:09.138620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 295/551] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:09 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:10.160185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:10.161237 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] [instance: 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:10.172358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:10.173092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:10.174344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:10.175078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:10.191732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] HTTP exception thrown: Instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 could not be found. Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Request method failure captured: Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 HTTP/1.1 Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeXMcQ0_o_qNTRQI8g9PtwmJ007UFL6IYF9l9vbUrWDLUgcQJj7mVw3W14vR_5GZz8pM4fJcbJQXqjv8M9QNmTuy-gyqIA6TliEbT8WOu-hYGhrVyV0uiuiBGzy0rlGCOM3VX9CJaKvzaECcKkijJBw5sEPTQ-J93NtHN4IM3JC0Gs Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:51:10.193344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_da2259120cca423686fd6e54d0ad2257", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/da2259120cca423686fd6e54d0ad2257"}]}] Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: da2259120cca423686fd6e54d0ad2257 Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1159531209 Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 563f1367093e493bae87a21374a3c2f3 Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1159531209-project Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 could not be found. Jul 21 05:51:10.194883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456'} Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 could not be found. Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:51:10.195749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 could not be found. Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 could not be found. Jul 21 05:51:10.197159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:10.198511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] Returning 404 to user: Instance 1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:51:10.198511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-680770e1-233a-439e-95e1-890e7b101d7a tempest-ServerRescueNegativeTestJSON-1159531209 tempest-ServerRescueNegativeTestJSON-1159531209-project] 10.222.0.44 "GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456" status: 404 len: 111 microversion: 2.1 time: 0.041531 Jul 21 05:51:10.198511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 296/552] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:10 2022] GET /compute/v2.1/servers/1dbfcb15-ab68-4c2f-8b6a-a0ffc7bff456 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:51:14.705759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-01167155-6600-40fe-9d1c-22028b8c80dc tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Action: 'create', calling method: .version_select at 0x7f50903ffb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-413274933", "metadata": {"Type": "work"}}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:15.003215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-01167155-6600-40fe-9d1c-22028b8c80dc tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.420799 Jul 21 05:51:15.004050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 297/553] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 05:51:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 422 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 05:51:15.015120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d7571cfa-a885-4c07-bdd6-96bc0b7d8713 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Calling method '.version_select at 0x7f509041fee0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:15.067790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d7571cfa-a885-4c07-bdd6-96bc0b7d8713 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c" status: 200 len: 352 microversion: 2.1 time: 0.056505 Jul 21 05:51:15.068358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 298/554] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:51:15 2022] GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:16.085453 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3cc493b5-645e-40da-bdd7-d141ad4de5c4 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Calling method '.version_select at 0x7f50903ed0d0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:16.135494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3cc493b5-645e-40da-bdd7-d141ad4de5c4 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c" status: 200 len: 353 microversion: 2.1 time: 0.057378 Jul 21 05:51:16.136576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 299/555] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:51:16 2022] GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:16.147203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-52001d63-12ab-47bf-b6d4-4ef8138f778b tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Calling method '.version_select at 0x7f509041f4c0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:16.194192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-52001d63-12ab-47bf-b6d4-4ef8138f778b tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c" status: 200 len: 353 microversion: 2.1 time: 0.050657 Jul 21 05:51:16.194738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 300/556] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:51:16 2022] GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:16.210441 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1f410c6c-5219-4bbd-b018-d0ce7d98e23c tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Calling method '.version_select at 0x7f50903ffee0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:16.285702 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1f410c6c-5219-4bbd-b018-d0ce7d98e23c tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c" status: 202 len: 0 microversion: 2.1 time: 0.078423 Jul 21 05:51:16.286601 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 301/557] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 05:51:16 2022] DELETE /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:51:16.298710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ea4aae99-9430-49e2-9bdf-4f58f63e145a tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Calling method '.version_select at 0x7f509046adc0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:16.354312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ea4aae99-9430-49e2-9bdf-4f58f63e145a tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c" status: 200 len: 352 microversion: 2.1 time: 0.061537 Jul 21 05:51:16.354876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 302/558] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:51:16 2022] GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:17.371830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8d39fa8f-eed4-4384-bf72-21fab9cf82b1 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Calling method '.version_select at 0x7f50903ff8b0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:17.405839 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-8d39fa8f-eed4-4384-bf72-21fab9cf82b1 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] HTTP exception thrown: Volume de6b87c5-a9d7-4162-9233-aafdcef4f63c could not be found. Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8d39fa8f-eed4-4384-bf72-21fab9cf82b1 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Request method failure captured: Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c HTTP/1.1 Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OlSG0FbtlQLQBRXA07Tk_LvxYoB7sm5vhG7F1fzOgnYj6fsaBTLEP5fN038En2OKu5QAZm5TCLY-YnfAIU6KdxOsG_e1ueQNq6-0WayI-oycTqNgKDQzvZA4f4tVpvHj_Na4QanOCu4qZSkj2br5rhxJxTJK19qxUlBasskmmEsdjk Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 0b28b45a23e540b597b4d83d3b99ddd4 Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesGetTestJSON-238434571 Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:51:17.409217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0b28b45a23e540b597b4d83d3b99ddd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b28b45a23e540b597b4d83d3b99ddd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0b28b45a23e540b597b4d83d3b99ddd4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0b28b45a23e540b597b4d83d3b99ddd4"}]}] Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesGetTestJSON-238434571 Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 0b28b45a23e540b597b4d83d3b99ddd4 Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesGetTestJSON-238434571 Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesGetTestJSON-238434571-project Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 4a4411196cd24dcf9864ff250341d153 Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesGetTestJSON-238434571-project Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Volume de6b87c5-a9d7-4162-9233-aafdcef4f63c could not be found. Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'de6b87c5-a9d7-4162-9233-aafdcef4f63c'} Jul 21 05:51:17.410746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de6b87c5-a9d7-4162-9233-aafdcef4f63c could not be found. (HTTP 404) (Request-ID: req-fe1dda9b-1ddb-4163-be3a-61d76c323128) Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:17.411759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 05:51:17.413160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de6b87c5-a9d7-4162-9233-aafdcef4f63c could not be found. Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 05:51:17.414507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de6b87c5-a9d7-4162-9233-aafdcef4f63c could not be found. Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de6b87c5-a9d7-4162-9233-aafdcef4f63c could not be found. Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8d39fa8f-eed4-4384-bf72-21fab9cf82b1 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] Returning 404 to user: Volume de6b87c5-a9d7-4162-9233-aafdcef4f63c could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8d39fa8f-eed4-4384-bf72-21fab9cf82b1 tempest-VolumesGetTestJSON-238434571 tempest-VolumesGetTestJSON-238434571-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c" status: 404 len: 109 microversion: 2.1 time: 0.046099 Jul 21 05:51:17.415934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 303/559] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 05:51:17 2022] GET /compute/v2.1/os-volumes/de6b87c5-a9d7-4162-9233-aafdcef4f63c => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:51:25.684223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:25.685149 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:25.689862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-409212758"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:25.690627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:25.698341 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:25.698995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:25.699948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:25.700584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:25.832824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.network.security_group_api [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Removing security group 99580340-eed9-4481-acc2-e2affe9ec140 from port 65160de7-4ce4-43e2-81e4-3e79539be1e9 Jul 21 05:51:26.182595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7a488bb3-cf1b-4208-ae63-aeefa9cc9299 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/action" status: 202 len: 0 microversion: 2.1 time: 0.499717 Jul 21 05:51:26.183815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 304/560] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:51:25 2022] POST /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:51:26.191560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-76a9d2fd-7b7b-4950-afc8-7eb9bd88a9e6 req-5419b188-ee97-462b-8cb3-9aa31d14eb3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a780a3-33bf-4c98-9363-3f5044165def", "tag": "65160de7-4ce4-43e2-81e4-3e79539be1e9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:26.203512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-76a9d2fd-7b7b-4950-afc8-7eb9bd88a9e6 req-5419b188-ee97-462b-8cb3-9aa31d14eb3e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:26.204209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-76a9d2fd-7b7b-4950-afc8-7eb9bd88a9e6 req-5419b188-ee97-462b-8cb3-9aa31d14eb3e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:26.220640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-76a9d2fd-7b7b-4950-afc8-7eb9bd88a9e6 req-5419b188-ee97-462b-8cb3-9aa31d14eb3e service nova] Creating event network-changed:65160de7-4ce4-43e2-81e4-3e79539be1e9 for instance 04a780a3-33bf-4c98-9363-3f5044165def on hv-cinder-85044 Jul 21 05:51:26.227821 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-76a9d2fd-7b7b-4950-afc8-7eb9bd88a9e6 req-5419b188-ee97-462b-8cb3-9aa31d14eb3e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040917 Jul 21 05:51:26.230106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 305/561] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:27.473220 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:27.473851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:27.480706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:27.481187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:27.482216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:27.482653 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:27.581832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lazy-loading 'services' on Instance uuid 04a780a3-33bf-4c98-9363-3f5044165def {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:51:27.667929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e94ce2bf-6950-40b6-8c89-1f735eb6bd0a tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "DELETE /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments/0ebc025a-e5b2-4cf4-875e-7a0cbce3e176" status: 202 len: 0 microversion: 2.1 time: 0.199178 Jul 21 05:51:27.668530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 306/562] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 05:51:27 2022] DELETE /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments/0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:51:27.922274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-8fa9e0e5-9bc5-40d4-b642-fcd8afedd113 req-719a5518-0d1f-407d-8798-ee0ca47cdd85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04a780a3-33bf-4c98-9363-3f5044165def", "tag": "65160de7-4ce4-43e2-81e4-3e79539be1e9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:27.931708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-8fa9e0e5-9bc5-40d4-b642-fcd8afedd113 req-719a5518-0d1f-407d-8798-ee0ca47cdd85 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:27.932295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-8fa9e0e5-9bc5-40d4-b642-fcd8afedd113 req-719a5518-0d1f-407d-8798-ee0ca47cdd85 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:27.945528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-8fa9e0e5-9bc5-40d4-b642-fcd8afedd113 req-719a5518-0d1f-407d-8798-ee0ca47cdd85 service nova] Creating event network-changed:65160de7-4ce4-43e2-81e4-3e79539be1e9 for instance 04a780a3-33bf-4c98-9363-3f5044165def on hv-cinder-85044 Jul 21 05:51:27.951330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-8fa9e0e5-9bc5-40d4-b642-fcd8afedd113 req-719a5518-0d1f-407d-8798-ee0ca47cdd85 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281418 Jul 21 05:51:27.952373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 307/563] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:27.958386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9eb3ee74-2626-46b8-8a97-eeb16047dd41 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:27.959446 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9eb3ee74-2626-46b8-8a97-eeb16047dd41 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:27.966109 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9eb3ee74-2626-46b8-8a97-eeb16047dd41 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:27.966689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9eb3ee74-2626-46b8-8a97-eeb16047dd41 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:27.967382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9eb3ee74-2626-46b8-8a97-eeb16047dd41 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:27.967989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9eb3ee74-2626-46b8-8a97-eeb16047dd41 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:27.997435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9eb3ee74-2626-46b8-8a97-eeb16047dd41 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043706 Jul 21 05:51:27.998174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 308/564] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 05:51:27 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:29.010475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ee533bdd-aa51-4d0f-b0af-db35a0f76c8b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:29.011669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ee533bdd-aa51-4d0f-b0af-db35a0f76c8b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:29.018597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee533bdd-aa51-4d0f-b0af-db35a0f76c8b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:29.019322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee533bdd-aa51-4d0f-b0af-db35a0f76c8b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:29.020086 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee533bdd-aa51-4d0f-b0af-db35a0f76c8b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:29.020511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee533bdd-aa51-4d0f-b0af-db35a0f76c8b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:29.058956 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ee533bdd-aa51-4d0f-b0af-db35a0f76c8b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052732 Jul 21 05:51:29.059691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 309/565] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 05:51:29 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 05:51:29.069619 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:29.070251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:29.076486 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:29.076874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:29.077637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:29.078069 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:29.154769 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] HTTP exception thrown: Instance 04a780a3-33bf-4c98-9363-3f5044165def is not attached to volume 0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Request method failure captured: Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments/0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 HTTP/1.1 Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2Ohlrb9INwfp3My3opBw5FzcrLhXURilOamcqJ4EWzvjDw3gmr3cnkkNHoN_gBe9kYe0gITD8IkucFGIT6fDVvZBg-Y-ZdBr0EIa2zpQ-T_beDXJSzcPPXCDhRo13_eB31n6kZeYGUx2BjY_ofLGfibQJg9ckctG6jeGjvfYOcncFdo Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: c1c0c1c0f91147b98e49acb05e14d2d2 Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestMinimumBasicScenario-976031503 Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:51:29.157574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c1c0c1c0f91147b98e49acb05e14d2d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1c0c1c0f91147b98e49acb05e14d2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c1c0c1c0f91147b98e49acb05e14d2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1c0c1c0f91147b98e49acb05e14d2d2"}]}] Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestMinimumBasicScenario-976031503 Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: c1c0c1c0f91147b98e49acb05e14d2d2 Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestMinimumBasicScenario-976031503 Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestMinimumBasicScenario-976031503-project Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 22b285ea44c0494d9fa611df20d66a27 Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestMinimumBasicScenario-976031503-project Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:51:29.158985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 04a780a3-33bf-4c98-9363-3f5044165def is not attached to volume 0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'server_id': '04a780a3-33bf-4c98-9363-3f5044165def', 'id': '0ebc025a-e5b2-4cf4-875e-7a0cbce3e176'} Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0ebc025a-e5b2-4cf4-875e-7a0cbce3e176. Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:51:29.159726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a780a3-33bf-4c98-9363-3f5044165def is not attached to volume 0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a780a3-33bf-4c98-9363-3f5044165def is not attached to volume 0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:29.160942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Returning 404 to user: Instance 04a780a3-33bf-4c98-9363-3f5044165def is not attached to volume 0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:51:29.161878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-68a672b6-6e6a-44d9-8c3f-a35ee3c6160d tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "DELETE /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments/0ebc025a-e5b2-4cf4-875e-7a0cbce3e176" status: 404 len: 154 microversion: 2.1 time: 0.093463 Jul 21 05:51:29.161878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 310/566] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 05:51:29 2022] DELETE /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def/os-volume_attachments/0ebc025a-e5b2-4cf4-875e-7a0cbce3e176 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 05:51:30.332330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:30.333150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:30.340006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:30.340462 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:30.341320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:30.341750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:30.369896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:51:30.455436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9080025e-f609-4e9c-a0b7-85fea2bb8a5b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "DELETE /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 204 len: 0 microversion: 2.1 time: 0.126660 Jul 21 05:51:30.456224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 311/567] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:51:30 2022] DELETE /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:51:30.465230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:30.466009 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:30.471980 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:30.472423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:30.473178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:30.473608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:30.613639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:30.621566 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-39651b83-4203-4f57-8c2c-11fffaf9b62b tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1554 microversion: 2.1 time: 0.160551 Jul 21 05:51:30.622242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 312/568] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:30 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:30.771965 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-da8d6a41-c403-4c76-9186-4fb86e0d2f46 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '.version_select at 0x7f5090364430>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:30.800448 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-da8d6a41-c403-4c76-9186-4fb86e0d2f46 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785966693" status: 204 len: 0 microversion: 2.20 time: 0.034853 Jul 21 05:51:30.801004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 313/569] 10.222.0.44 () {60 vars in 1261 bytes} [Thu Jul 21 05:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1785966693 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 05:51:30.886523 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-648271314", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "networks": [{"uuid": "c6b5004c-0888-4301-8be5-e395e67f870e"}]}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:30.941989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] validate_networks() for [('c6b5004c-0888-4301-8be5-e395e67f870e', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:51:31.369673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:51:31.370271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:51:31.370616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:51:31.371046 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:51:31.371463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:51:31.381269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:31.381713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:31.382534 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:31.382985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:31.400840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Getting quotas for project 4a6ca476be674ec4a96993f135f66a80. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:51:31.405138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Getting quotas for user ef4ed725d22a4826bd8c7ef0b8c4df67 and project 4a6ca476be674ec4a96993f135f66a80. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:51:31.417092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:51:31.419553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:51:31.464707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f269a007-bb2c-4d11-b5ae-fc65dba5cc01 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581848 Jul 21 05:51:31.465811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 314/570] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:51:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 05:51:31.475724 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2619ceb6-8a2d-4279-be45-4360e6d58a4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'create', calling method: .version_select at 0x7f5090471b80>, body: {"keypair": {"name": "tempest-keypair-31471644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfs3b3OdYBIJsghvqkmNIxAZKP9NXjDIrTFBeydSq5JjM+HY0LzbELNfO4FuDE1d0Mht6PeP7qufKwTiyopD99rnzlJCZlOB80mrnISEf6hntbrDFU0GYhs4ArJsdRLNQ=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:31.491382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-2619ceb6-8a2d-4279-be45-4360e6d58a4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for project 7b88b7408762493e825c86d05b5e62bc. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:51:31.495356 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-2619ceb6-8a2d-4279-be45-4360e6d58a4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for user 0cbf797171144c139c72c516cea59bb9 and project 7b88b7408762493e825c86d05b5e62bc. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:51:31.517557 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2619ceb6-8a2d-4279-be45-4360e6d58a4a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.045669 Jul 21 05:51:31.518371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 315/571] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jul 21 05:51:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 21 05:51:31.522877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5e240e5b-c3ed-44ac-b9e8-f7a14219d086 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:31.523716 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5e240e5b-c3ed-44ac-b9e8-f7a14219d086 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:31.849337 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5e240e5b-c3ed-44ac-b9e8-f7a14219d086 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:31.866079 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5e240e5b-c3ed-44ac-b9e8-f7a14219d086 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1213 microversion: 2.1 time: 0.346793 Jul 21 05:51:31.866673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 316/572] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:31 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:31.873887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:31.874513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:31.891615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:31.892230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:31.893489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:31.894178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:32.078027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:32.087188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-34533183-4b29-4cfa-ac2d-9cbaa1cab375 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1554 microversion: 2.1 time: 0.216927 Jul 21 05:51:32.087992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 317/573] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:31 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:32.886114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:32.886791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:32.895912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:32.896898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:32.898709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:32.899512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:33.041336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:33.050079 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a253afaa-2f83-4763-a880-492db21b9ebe tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1283 microversion: 2.1 time: 0.170613 Jul 21 05:51:33.050992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 318/574] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:32 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:33.105361 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:33.106342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:33.113189 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:33.113628 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:33.114382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:33.114811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:33.424030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b285ea44c0494d9fa611df20d66a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c0c1c0f91147b98e49acb05e14d2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:33.432159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-95d06ade-5cc8-45d4-a47b-16fd04adfd85 tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 200 len: 1554 microversion: 2.1 time: 0.330865 Jul 21 05:51:33.432805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 319/575] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:33 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 1554 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:33.437910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-920377755", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9839c83c-0406-4627-8776-66ce5f345f2a"}], "security_groups": [{"name": "tempest-securitygroup--1333367153"}], "key_name": "tempest-keypair-31471644", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:33.633066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] validate_networks() for [('9839c83c-0406-4627-8776-66ce5f345f2a', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:51:34.320142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:51:34.320747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:51:34.321258 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:51:34.321690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:51:34.322125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:51:34.332643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:34.333057 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:34.334058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:34.334584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:34.353049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for project 7b88b7408762493e825c86d05b5e62bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:51:34.357568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Getting quotas for user 0cbf797171144c139c72c516cea59bb9 and project 7b88b7408762493e825c86d05b5e62bc. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:51:34.369801 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:51:34.372782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:51:34.425727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d406e8d5-44e0-42d4-a7e3-aba286385af3 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.991474 Jul 21 05:51:34.427058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 320/576] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jul 21 05:51:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 05:51:34.437281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-2982ab2d-39c2-47f1-a990-7994406facdf req-8041f647-8955-49bc-a88a-13ff6fd87087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04a780a3-33bf-4c98-9363-3f5044165def", "name": "network-vif-deleted", "tag": "65160de7-4ce4-43e2-81e4-3e79539be1e9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:34.446477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2982ab2d-39c2-47f1-a990-7994406facdf req-8041f647-8955-49bc-a88a-13ff6fd87087 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:34.446633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2982ab2d-39c2-47f1-a990-7994406facdf req-8041f647-8955-49bc-a88a-13ff6fd87087 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:34.460747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-2982ab2d-39c2-47f1-a990-7994406facdf req-8041f647-8955-49bc-a88a-13ff6fd87087 service nova] Creating event network-vif-deleted:65160de7-4ce4-43e2-81e4-3e79539be1e9 for instance 04a780a3-33bf-4c98-9363-3f5044165def on hv-cinder-85044 Jul 21 05:51:34.465614 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-2982ab2d-39c2-47f1-a990-7994406facdf req-8041f647-8955-49bc-a88a-13ff6fd87087 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032088 Jul 21 05:51:34.466440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 321/577] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:34.471220 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:34.471910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:34.477993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:34.478439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:34.479225 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:34.479645 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:34.706200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:34.713903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-14ab5e56-3fb8-41ee-87cd-0a1b094ee714 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.246459 Jul 21 05:51:34.714642 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 322/578] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:34 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:34.720324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-60af8aa2-7b20-4830-bf37-72fc4c6b6a86 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:34.721161 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-60af8aa2-7b20-4830-bf37-72fc4c6b6a86 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:34.791678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-60af8aa2-7b20-4830-bf37-72fc4c6b6a86 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:34.801114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-60af8aa2-7b20-4830-bf37-72fc4c6b6a86 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:34.803878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-60af8aa2-7b20-4830-bf37-72fc4c6b6a86 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:34.805594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-60af8aa2-7b20-4830-bf37-72fc4c6b6a86 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1279 microversion: 2.20 time: 0.089592 Jul 21 05:51:34.806420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 323/579] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:34 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:34.821059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:34.821678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] [instance: 04a780a3-33bf-4c98-9363-3f5044165def] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:34.828496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:34.828985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:34.829761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:34.830195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:34.845303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] HTTP exception thrown: Instance 04a780a3-33bf-4c98-9363-3f5044165def could not be found. Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Request method failure captured: Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def HTTP/1.1 Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2Ohlrb9INwfp3My3opBw5FzcrLhXURilOamcqJ4EWzvjDw3gmr3cnkkNHoN_gBe9kYe0gITD8IkucFGIT6fDVvZBg-Y-ZdBr0EIa2zpQ-T_beDXJSzcPPXCDhRo13_eB31n6kZeYGUx2BjY_ofLGfibQJg9ckctG6jeGjvfYOcncFdo Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: c1c0c1c0f91147b98e49acb05e14d2d2 Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestMinimumBasicScenario-976031503 Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:51:34.847655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c1c0c1c0f91147b98e49acb05e14d2d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1c0c1c0f91147b98e49acb05e14d2d2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c1c0c1c0f91147b98e49acb05e14d2d2", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c1c0c1c0f91147b98e49acb05e14d2d2"}]}] Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestMinimumBasicScenario-976031503 Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: c1c0c1c0f91147b98e49acb05e14d2d2 Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestMinimumBasicScenario-976031503 Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestMinimumBasicScenario-976031503-project Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 22b285ea44c0494d9fa611df20d66a27 Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestMinimumBasicScenario-976031503-project Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 04a780a3-33bf-4c98-9363-3f5044165def could not be found. Jul 21 05:51:34.849066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '04a780a3-33bf-4c98-9363-3f5044165def'} Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04a780a3-33bf-4c98-9363-3f5044165def could not be found. Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:51:34.849820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04a780a3-33bf-4c98-9363-3f5044165def could not be found. Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04a780a3-33bf-4c98-9363-3f5044165def could not be found. Jul 21 05:51:34.851097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:34.852227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Returning 404 to user: Instance 04a780a3-33bf-4c98-9363-3f5044165def could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:51:34.852227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-986a332f-154b-4f61-9d5d-dd79ce42068e tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def" status: 404 len: 111 microversion: 2.1 time: 0.040854 Jul 21 05:51:34.853025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 324/580] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:34 2022] GET /compute/v2.1/servers/04a780a3-33bf-4c98-9363-3f5044165def => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:51:34.858204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dcfcb704-9fdf-47cc-bab8-fcbd951fe4de tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] Calling method '.version_select at 0x7f509041fc10>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:34.878280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dcfcb704-9fdf-47cc-bab8-fcbd951fe4de tempest-TestMinimumBasicScenario-976031503 tempest-TestMinimumBasicScenario-976031503-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1166173600" status: 202 len: 0 microversion: 2.1 time: 0.024003 Jul 21 05:51:34.878910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 325/581] 10.222.0.44 () {58 vars in 1271 bytes} [Thu Jul 21 05:51:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1166173600 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:51:35.732096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:35.734135 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:35.737555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:35.742695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:35.743173 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:35.744013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:35.744388 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:36.150225 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:36.158872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-55caf8f1-1e3a-4707-9348-ce24114575f7 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.431342 Jul 21 05:51:36.159698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 326/582] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:35 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:36.164904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:36.165491 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:36.175955 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:36.176408 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:36.177182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:36.177624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:36.196429 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:36.289465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:36.298569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:36.300216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:36.301342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b2f5567f-2a62-4783-821e-7a284d3c8462 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1337 microversion: 2.20 time: 0.140554 Jul 21 05:51:36.301878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 327/583] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:36 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1337 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:36.482756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-8fd6e4c9-f35d-4aa3-b265-d9ae2895b166 req-c21e71e4-9a8c-44a3-8fbb-5226a83af1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba8286b-0d25-4177-ab73-ebf6803dbb2f", "tag": "87de3952-72d6-45ba-84ad-254facb1024d"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:36.491810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-8fd6e4c9-f35d-4aa3-b265-d9ae2895b166 req-c21e71e4-9a8c-44a3-8fbb-5226a83af1cb service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:36.492330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-8fd6e4c9-f35d-4aa3-b265-d9ae2895b166 req-c21e71e4-9a8c-44a3-8fbb-5226a83af1cb service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:36.504406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-8fd6e4c9-f35d-4aa3-b265-d9ae2895b166 req-c21e71e4-9a8c-44a3-8fbb-5226a83af1cb service nova] Creating event network-changed:87de3952-72d6-45ba-84ad-254facb1024d for instance eba8286b-0d25-4177-ab73-ebf6803dbb2f on hv-cinder-85044 Jul 21 05:51:36.509559 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-8fd6e4c9-f35d-4aa3-b265-d9ae2895b166 req-c21e71e4-9a8c-44a3-8fbb-5226a83af1cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031406 Jul 21 05:51:36.510619 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 328/584] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:37.177138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:37.177968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:37.184848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:37.185416 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:37.186189 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:37.186621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:37.326592 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:37.334570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4b451a41-8195-43b9-962e-2d72830696d2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.162148 Jul 21 05:51:37.335279 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 329/585] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:37 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:37.339971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:37.340901 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:37.348687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:37.349202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:37.350030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:37.350539 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:37.485401 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:37.494691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:37.496599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:37.497957 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e1e8218d-8dd4-4eab-a0b3-72446b54fbb9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.161381 Jul 21 05:51:37.498620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 330/586] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:37 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:38.352375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:38.353904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:38.361205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:38.361631 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:38.362704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:38.363165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:38.652973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:38.663234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-aa4fd97e-aad7-4379-b063-2eafff2302e3 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.314654 Jul 21 05:51:38.666170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 331/587] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:38 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:38.671304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:38.672173 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:38.678174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:38.678798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:38.679888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:38.680468 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:39.098514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:39.108139 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:39.109855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:39.111050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3ae7b66c-fe03-4989-8c4a-a9812f6dba3b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.443764 Jul 21 05:51:39.111780 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 332/588] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:38 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:39.682465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:39.683123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:39.691746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:39.692909 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:39.693856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:39.694793 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:39.971442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:39.981585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-24f37a18-6511-4501-b945-2214bab715ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.302925 Jul 21 05:51:39.982412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 333/589] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:39 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:39.989604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-51c10261-e093-4700-aee4-1b7030778c57 req-8fa288b1-5356-4f19-bfe1-8bd5963ced94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7775f455-5795-417b-9527-5541344dead1", "tag": "d2b7fbe9-4495-4de8-b167-ed4d5ac257d8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:39.999500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-51c10261-e093-4700-aee4-1b7030778c57 req-8fa288b1-5356-4f19-bfe1-8bd5963ced94 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:39.999963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-51c10261-e093-4700-aee4-1b7030778c57 req-8fa288b1-5356-4f19-bfe1-8bd5963ced94 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:40.013302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-51c10261-e093-4700-aee4-1b7030778c57 req-8fa288b1-5356-4f19-bfe1-8bd5963ced94 service nova] Creating event network-changed:d2b7fbe9-4495-4de8-b167-ed4d5ac257d8 for instance 7775f455-5795-417b-9527-5541344dead1 on hv-cinder-85044 Jul 21 05:51:40.018157 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-51c10261-e093-4700-aee4-1b7030778c57 req-8fa288b1-5356-4f19-bfe1-8bd5963ced94 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034274 Jul 21 05:51:40.018828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 334/590] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:40.130467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:40.131203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:40.139608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:40.140353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:40.141361 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:40.141981 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:40.371893 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:40.382041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:40.383787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:40.384918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f6623597-6195-429a-b20a-488d2b854146 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.259719 Jul 21 05:51:40.385477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 335/591] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:40 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:40.389983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-77b2f5ff-81ab-4c11-95ef-1abc2ba478f1 req-9b1431c5-fc62-4993-906f-7ef623ab108c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba8286b-0d25-4177-ab73-ebf6803dbb2f", "name": "network-vif-plugged", "status": "completed", "tag": "87de3952-72d6-45ba-84ad-254facb1024d"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:40.398242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-77b2f5ff-81ab-4c11-95ef-1abc2ba478f1 req-9b1431c5-fc62-4993-906f-7ef623ab108c service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:40.398672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-77b2f5ff-81ab-4c11-95ef-1abc2ba478f1 req-9b1431c5-fc62-4993-906f-7ef623ab108c service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:40.412150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-77b2f5ff-81ab-4c11-95ef-1abc2ba478f1 req-9b1431c5-fc62-4993-906f-7ef623ab108c service nova] Creating event network-vif-plugged:87de3952-72d6-45ba-84ad-254facb1024d for instance eba8286b-0d25-4177-ab73-ebf6803dbb2f on hv-cinder-85044 Jul 21 05:51:40.418242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-77b2f5ff-81ab-4c11-95ef-1abc2ba478f1 req-9b1431c5-fc62-4993-906f-7ef623ab108c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Jul 21 05:51:40.419930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 336/592] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:40.999874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:41.000911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:41.007768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:41.008501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:41.009380 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:41.009847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:41.497773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:41.505534 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4f6b6b48-59c5-4b12-a08f-f03c336743ce tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.510017 Jul 21 05:51:41.506342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 337/593] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:40 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:41.510922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:41.511558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:41.517579 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:41.518027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:41.518791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:41.519258 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:41.730820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:41.740326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:41.741898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:41.743342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-702e3dbb-0eb5-4a0d-996f-e345e76cac33 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.235915 Jul 21 05:51:41.745412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 338/594] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:41 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:42.524296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:42.525887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:42.535483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:42.535930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:42.536798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:42.537395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:42.884682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:42.898376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-940777b6-026e-4f7c-a2ad-f925140b5666 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.378485 Jul 21 05:51:42.900962 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 339/595] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:42 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:42.909875 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:42.915429 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:42.928818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:42.929772 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:42.931047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:42.931874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:43.094703 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:43.105237 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:43.107045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:43.108213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-63c4fc05-bea0-434c-9075-da4022e4f7c1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.206289 Jul 21 05:51:43.108865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 340/596] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:42 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:43.916396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:43.917013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:43.923352 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:43.923946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:43.924720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:43.925144 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:44.112922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:44.121883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d8cada2f-d405-4d2e-99d4-1edebb043e4b tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1313 microversion: 2.1 time: 0.208852 Jul 21 05:51:44.122894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 341/597] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:43 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:44.127804 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:44.128413 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:44.134461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:44.134909 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:44.135723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:44.136638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:44.298651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:44.307313 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:44.309131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:44.310879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-77be0033-3b9d-4a5b-a6ca-36e491679813 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.186772 Jul 21 05:51:44.311487 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 342/598] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:44 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:44.316199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-356f4dfe-0848-4c10-9b39-74968ba9317d req-4aa06f0e-010c-4383-b6dd-767411bf6355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7775f455-5795-417b-9527-5541344dead1", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7fbe9-4495-4de8-b167-ed4d5ac257d8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:44.324769 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-356f4dfe-0848-4c10-9b39-74968ba9317d req-4aa06f0e-010c-4383-b6dd-767411bf6355 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:44.325196 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-356f4dfe-0848-4c10-9b39-74968ba9317d req-4aa06f0e-010c-4383-b6dd-767411bf6355 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:44.337555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-356f4dfe-0848-4c10-9b39-74968ba9317d req-4aa06f0e-010c-4383-b6dd-767411bf6355 service nova] Creating event network-vif-plugged:d2b7fbe9-4495-4de8-b167-ed4d5ac257d8 for instance 7775f455-5795-417b-9527-5541344dead1 on hv-cinder-85044 Jul 21 05:51:44.342830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-356f4dfe-0848-4c10-9b39-74968ba9317d req-4aa06f0e-010c-4383-b6dd-767411bf6355 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030011 Jul 21 05:51:44.343460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 343/599] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:45.137043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:45.137982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=20 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:45.143224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:45.143941 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:45.151973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:45.152426 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:45.153272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:45.153709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:45.347365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:45.355431 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-55138082-ff58-4ba3-a585-32dca7410d52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1497 microversion: 2.1 time: 0.219304 Jul 21 05:51:45.356044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 344/600] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:45 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:45.360712 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:45.361530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:45.369709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:45.370396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:45.371471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:45.372113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:45.514572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:45.522695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:45.524490 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:45.525656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ae13bf6f-2cce-495d-aabb-2d5a4c93b7e9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.168470 Jul 21 05:51:45.526210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 345/601] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:45 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:45.865242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:45.866250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:45.873774 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:45.874512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:45.875561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:45.876268 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:45.905022 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:51:45.908546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:45.997461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-04b8d9cf-5abc-4a81-adad-0443aa933723 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 204 len: 0 microversion: 2.1 time: 0.135916 Jul 21 05:51:45.998471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 346/602] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:51:45 2022] DELETE /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 05:51:46.007633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:46.008724 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:46.015836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:46.016624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:46.017620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:46.018255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:46.169220 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:46.177763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9a1586c6-916f-44cc-aa31-68864b089665 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1503 microversion: 2.1 time: 0.174481 Jul 21 05:51:46.178597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 347/603] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:46 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:46.545085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:46.545703 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:46.553376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:46.553829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:46.554618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:46.555130 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:46.700085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:46.708277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:46.709779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:46.710870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9b1728f3-f8f1-4295-915b-8714f798b709 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1405 microversion: 2.20 time: 0.170140 Jul 21 05:51:46.711478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 348/604] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:46 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:51:47.195960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:47.196603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:47.203737 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:47.204183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:47.204942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:47.205370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:47.345216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:47.353840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3e2636f3-69cf-43ce-bb22-12621bbf44db tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1503 microversion: 2.1 time: 0.161724 Jul 21 05:51:47.354413 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 349/605] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:47 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:47.729004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:47.729736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:47.736511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:47.737068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:47.738162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:47.738665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:47.922324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:47.933971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:47.941646 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:47.943212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9d660b72-6884-4454-92b8-414459ee2f7d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1596 microversion: 2.20 time: 0.218158 Jul 21 05:51:47.944340 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 350/606] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:51:47 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1596 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:51:47.963606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8acbb154-ef25-44dc-b6ce-e46a03f8ec76 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:47.964138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8acbb154-ef25-44dc-b6ce-e46a03f8ec76 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:47.973216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8acbb154-ef25-44dc-b6ce-e46a03f8ec76 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:47.973682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8acbb154-ef25-44dc-b6ce-e46a03f8ec76 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:47.974618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8acbb154-ef25-44dc-b6ce-e46a03f8ec76 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:47.975080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8acbb154-ef25-44dc-b6ce-e46a03f8ec76 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:48.067861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8acbb154-ef25-44dc-b6ce-e46a03f8ec76 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108072 Jul 21 05:51:48.074564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 351/607] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jul 21 05:51:47 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:51:48.372489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:48.373236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:48.384850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:48.385589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:48.386485 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:48.387896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:48.848513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:48.858336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ee4f91de-1800-44f9-b509-2bb2d65af3a2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1503 microversion: 2.1 time: 0.490915 Jul 21 05:51:48.869069 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 352/608] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:48 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:49.575741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-4220e4ca-6963-4f26-94a1-6c2fbfdf04c6 req-5e97a83e-61b7-4818-b400-a9003e91eb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba8286b-0d25-4177-ab73-ebf6803dbb2f", "name": "network-vif-deleted", "tag": "87de3952-72d6-45ba-84ad-254facb1024d"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:49.585705 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-4220e4ca-6963-4f26-94a1-6c2fbfdf04c6 req-5e97a83e-61b7-4818-b400-a9003e91eb44 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:49.586475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-4220e4ca-6963-4f26-94a1-6c2fbfdf04c6 req-5e97a83e-61b7-4818-b400-a9003e91eb44 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:49.601682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-4220e4ca-6963-4f26-94a1-6c2fbfdf04c6 req-5e97a83e-61b7-4818-b400-a9003e91eb44 service nova] Creating event network-vif-deleted:87de3952-72d6-45ba-84ad-254facb1024d for instance eba8286b-0d25-4177-ab73-ebf6803dbb2f on hv-cinder-85044 Jul 21 05:51:49.608184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-4220e4ca-6963-4f26-94a1-6c2fbfdf04c6 req-5e97a83e-61b7-4818-b400-a9003e91eb44 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036542 Jul 21 05:51:49.609747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 353/609] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:49.876066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:49.876781 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:49.885502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:49.885948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:49.886712 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:49.887371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:49.925360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:49.926062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:49.926660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lazy-loading 'fault' on Instance uuid eba8286b-0d25-4177-ab73-ebf6803dbb2f {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:51:49.975342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:49.983814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-88bf00b9-0035-4f44-9637-d0e8bbd3b67f tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 200 len: 1303 microversion: 2.1 time: 0.111880 Jul 21 05:51:49.994974 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 354/610] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:49 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 1303 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:51.001822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:51.003318 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: eba8286b-0d25-4177-ab73-ebf6803dbb2f] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:51.017215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:51.017663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:51.018634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:51.019094 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:51.040083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] HTTP exception thrown: Instance eba8286b-0d25-4177-ab73-ebf6803dbb2f could not be found. Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Request method failure captured: Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f HTTP/1.1 Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OlhFsMoalPQQsdP62Zvwqy1Rc3WVzi7Cr--SlZx_-sxobNd7IwHZ1tZMIUoMzzpnZaikMpCgHSJ3uAy8eIufqNOHSN-8fjxJY7hIpDT41l8qyaQVP5hxi-ITnfZ_7vOE5kSyEMydkcKkORqn1x1_jcUujnUvlDN2XPlugRzOiRcvJY Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 4a6ca476be674ec4a96993f135f66a80 Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesActionsTest-1909065468 Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:51:51.041986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a6ca476be674ec4a96993f135f66a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a6ca476be674ec4a96993f135f66a80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a6ca476be674ec4a96993f135f66a80", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a6ca476be674ec4a96993f135f66a80"}]}] Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesActionsTest-1909065468 Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 4a6ca476be674ec4a96993f135f66a80 Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesActionsTest-1909065468 Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesActionsTest-1909065468-project Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: ef4ed725d22a4826bd8c7ef0b8c4df67 Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesActionsTest-1909065468-project Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance eba8286b-0d25-4177-ab73-ebf6803dbb2f could not be found. Jul 21 05:51:51.043545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'eba8286b-0d25-4177-ab73-ebf6803dbb2f'} Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba8286b-0d25-4177-ab73-ebf6803dbb2f could not be found. Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:51:51.044326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba8286b-0d25-4177-ab73-ebf6803dbb2f could not be found. Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba8286b-0d25-4177-ab73-ebf6803dbb2f could not be found. Jul 21 05:51:51.046696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:51:51.048458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Returning 404 to user: Instance eba8286b-0d25-4177-ab73-ebf6803dbb2f could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:51:51.048458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-43de56f5-bbef-4520-9ef7-9fda9782bbc9 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f" status: 404 len: 111 microversion: 2.1 time: 0.046506 Jul 21 05:51:51.048458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 355/611] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:50 2022] GET /compute/v2.1/servers/eba8286b-0d25-4177-ab73-ebf6803dbb2f => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 05:51:51.226135 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1703398415", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "networks": [{"uuid": "c6b5004c-0888-4301-8be5-e395e67f870e"}]}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:51.290349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] validate_networks() for [('c6b5004c-0888-4301-8be5-e395e67f870e', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:51:52.130884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:51:52.131552 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:51:52.132847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:51:52.133409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:51:52.134182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:51:52.147467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:52.149001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:52.149993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:52.150912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:52.187669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Getting quotas for project 4a6ca476be674ec4a96993f135f66a80. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:51:52.192255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Getting quotas for user ef4ed725d22a4826bd8c7ef0b8c4df67 and project 4a6ca476be674ec4a96993f135f66a80. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:51:52.207998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:51:52.211069 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:51:52.294264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8c42f896-44d3-4f63-9ae6-217f00c3e455 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072167 Jul 21 05:51:52.297629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 356/612] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:51:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:51:52.326064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-376ccb17-3139-4393-b8c7-20cce0052238 req-87ac9a6b-c670-4a65-aac3-983cee0ab661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7775f455-5795-417b-9527-5541344dead1", "tag": "d2b7fbe9-4495-4de8-b167-ed4d5ac257d8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:52.343492 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-376ccb17-3139-4393-b8c7-20cce0052238 req-87ac9a6b-c670-4a65-aac3-983cee0ab661 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:52.344202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-376ccb17-3139-4393-b8c7-20cce0052238 req-87ac9a6b-c670-4a65-aac3-983cee0ab661 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:52.358560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-376ccb17-3139-4393-b8c7-20cce0052238 req-87ac9a6b-c670-4a65-aac3-983cee0ab661 service nova] Creating event network-changed:d2b7fbe9-4495-4de8-b167-ed4d5ac257d8 for instance 7775f455-5795-417b-9527-5541344dead1 on hv-cinder-85044 Jul 21 05:51:52.375742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-376ccb17-3139-4393-b8c7-20cce0052238 req-87ac9a6b-c670-4a65-aac3-983cee0ab661 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074822 Jul 21 05:51:52.377845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 357/613] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:52.387391 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-be45881a-8b94-4f7a-8d52-e016b7f50da4 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:52.388349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-be45881a-8b94-4f7a-8d52-e016b7f50da4 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:52.527210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-be45881a-8b94-4f7a-8d52-e016b7f50da4 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:52.536758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-be45881a-8b94-4f7a-8d52-e016b7f50da4 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1214 microversion: 2.1 time: 0.157459 Jul 21 05:51:52.542004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 358/614] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:52 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:53.556696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:53.559287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:53.569900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:53.570681 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:53.571742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:53.572419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:54.019160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:54.030805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7af80b70-513b-4878-972c-bc96e1758bb1 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1210 microversion: 2.1 time: 0.477711 Jul 21 05:51:54.032124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 359/615] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:53 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1210 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:55.049089 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:55.053009 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:55.063303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:55.064286 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:55.065233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:55.065827 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:55.148612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:55.157174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-163f6db7-0402-4b70-8ff2-cd6eb9ce09b2 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1272 microversion: 2.1 time: 0.111688 Jul 21 05:51:55.158334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 360/616] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:55 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:56.175823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:56.176629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:56.186721 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:56.187307 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:56.188381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:56.189243 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:56.732705 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:56.741521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b4fe6f50-b30a-4b18-af13-1dcaf1e61da5 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.571400 Jul 21 05:51:56.751360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 361/617] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:56 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:51:56.951305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-34333d5c-3128-4bc3-bd54-cd3ab76b2a35 req-19d650c6-aa1b-407f-a265-7122ea8400a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a214da7a-8c90-48be-8343-ad8703669383", "tag": "98e05ff3-166e-4ce6-8f09-e790bd4da7c9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:56.961641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-34333d5c-3128-4bc3-bd54-cd3ab76b2a35 req-19d650c6-aa1b-407f-a265-7122ea8400a2 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:56.962972 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-34333d5c-3128-4bc3-bd54-cd3ab76b2a35 req-19d650c6-aa1b-407f-a265-7122ea8400a2 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:56.975385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-34333d5c-3128-4bc3-bd54-cd3ab76b2a35 req-19d650c6-aa1b-407f-a265-7122ea8400a2 service nova] Creating event network-changed:98e05ff3-166e-4ce6-8f09-e790bd4da7c9 for instance a214da7a-8c90-48be-8343-ad8703669383 on hv-cinder-85044 Jul 21 05:51:56.980857 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-34333d5c-3128-4bc3-bd54-cd3ab76b2a35 req-19d650c6-aa1b-407f-a265-7122ea8400a2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033642 Jul 21 05:51:56.981788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 362/618] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:57.762467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:57.767271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:57.780934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:57.782061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:57.783526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:57.785644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:57.985171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:57.996698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-90ffa083-1355-42a6-8be4-3e4a70e487d0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.242078 Jul 21 05:51:57.997599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 363/619] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:57 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:51:58.211617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7a751f8a-98b8-4211-9fe1-047d93ef43f5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Action: 'create', calling method: .version_select at 0x7f509031d3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-541431774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFmlvXTeRkmWiJAAUtlOmP8hlyighlLaDxwDEH6/WKimR7m3FY6kUuBW8BAo4su4jHrwRzGnMkVV1g28CvR03x/6jSJ/xsE4fam8cRAfDWZOT2WbAERDD1si198N0QbcA=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:51:58.216994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:51:58.227970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-7a751f8a-98b8-4211-9fe1-047d93ef43f5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Getting quotas for project 6c683289fa724e71bb7a9f69154c84a1. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:51:58.232542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-7a751f8a-98b8-4211-9fe1-047d93ef43f5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Getting quotas for user b894a36d43224aba9fc4b14b151e75b2 and project 6c683289fa724e71bb7a9f69154c84a1. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:51:58.255276 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7a751f8a-98b8-4211-9fe1-047d93ef43f5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.256612 Jul 21 05:51:58.256102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 364/620] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 05:51:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:51:59.014620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:51:59.015355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:51:59.024019 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:59.024744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:59.026040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:51:59.026797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:51:59.244678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:51:59.260074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-64895de7-dd03-4526-b5c0-8643ca8d1140 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.248065 Jul 21 05:51:59.261726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 365/621] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:51:59 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:00.277823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:00.278460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:00.285621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:00.286064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:00.286831 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:00.287287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:00.513818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:00.521390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-96e65575-c78a-4eb9-8867-8aa709a71b42 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.247499 Jul 21 05:52:00.521998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 366/622] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:00 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:01.539602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:01.540283 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:01.547652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:01.548097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:01.548866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:01.549292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:01.553518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:01.685285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:01.693101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-02a33218-0944-40ec-ac4a-4d19eaa2d1c0 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.157658 Jul 21 05:52:01.693670 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 367/623] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:01 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:02.714106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:02.714784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:02.717417 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:02.724097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:02.724538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:02.725334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:02.725766 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:02.868869 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:02.877171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e25153e3-7f58-4ee9-ba9e-35ccdfb65437 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.168976 Jul 21 05:52:02.877754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 368/624] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:02 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:03.895298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:03.895914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:03.902862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:03.903338 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:03.904095 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:03.904526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:04.040217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:04.048029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d5282514-5294-4e11-8e28-3ee6167dd943 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.156774 Jul 21 05:52:04.048596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 369/625] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:03 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:04.345788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-5e44d06c-b8b0-49eb-bd00-b79e56af4b99 req-c4c0a17d-2912-4897-91d4-42ff6838db80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a214da7a-8c90-48be-8343-ad8703669383", "name": "network-vif-plugged", "status": "completed", "tag": "98e05ff3-166e-4ce6-8f09-e790bd4da7c9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:52:04.354335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-5e44d06c-b8b0-49eb-bd00-b79e56af4b99 req-c4c0a17d-2912-4897-91d4-42ff6838db80 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:04.354961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-5e44d06c-b8b0-49eb-bd00-b79e56af4b99 req-c4c0a17d-2912-4897-91d4-42ff6838db80 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:04.370101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-5e44d06c-b8b0-49eb-bd00-b79e56af4b99 req-c4c0a17d-2912-4897-91d4-42ff6838db80 service nova] Creating event network-vif-plugged:98e05ff3-166e-4ce6-8f09-e790bd4da7c9 for instance a214da7a-8c90-48be-8343-ad8703669383 on hv-cinder-85044 Jul 21 05:52:04.375166 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-5e44d06c-b8b0-49eb-bd00-b79e56af4b99 req-c4c0a17d-2912-4897-91d4-42ff6838db80 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033349 Jul 21 05:52:04.375943 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 370/626] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:52:05.065962 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:05.066715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:05.074319 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:05.074759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:05.075554 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:05.075982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:05.215870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:05.225148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2ee524ff-7ae9-4c1a-b4a2-c1bab5debd52 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1314 microversion: 2.1 time: 0.163489 Jul 21 05:52:05.225739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 371/627] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:05 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:06.248511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:06.249231 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:06.256602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:06.257047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:06.257877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:06.258320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:06.392025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:06.400383 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-640c5a1c-28a4-4c94-b6ad-8d0bb03b7315 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1499 microversion: 2.1 time: 0.158235 Jul 21 05:52:06.400957 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 372/628] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:06 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:07.009017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:07.009697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:07.016131 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:07.016580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:07.017350 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:07.017784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:07.043644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:52:07.126620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a51ccacc-573c-4351-847e-fd1f02c1fa7c tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 204 len: 0 microversion: 2.1 time: 0.120808 Jul 21 05:52:07.130922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 373/629] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:52:07 2022] DELETE /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 05:52:07.137360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:07.138043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:07.144572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:07.145022 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:07.145788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:07.146218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:07.282180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:07.290288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3d33bc50-ba65-4774-a5a8-b66e1c678188 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1505 microversion: 2.1 time: 0.157913 Jul 21 05:52:07.291230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 374/630] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:07 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:08.308548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:08.309260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:08.311245 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=12 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:08.317464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:08.317913 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:08.318682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:08.319146 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:08.458052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:08.466101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d0e30136-c552-4314-94a0-de881bb24d68 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1505 microversion: 2.1 time: 0.161634 Jul 21 05:52:08.466679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 375/631] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:08 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:09.484040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:09.484708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:09.491392 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:09.491808 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:09.492564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:09.492991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:09.684055 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef4ed725d22a4826bd8c7ef0b8c4df67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a6ca476be674ec4a96993f135f66a80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:09.692315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b0489bbc-6b63-460f-91ed-1d78f8f35d86 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 200 len: 1505 microversion: 2.1 time: 0.212058 Jul 21 05:52:09.693194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 376/632] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:09 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:09.806297 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-12ccf9dc-c097-468e-9f09-28db37e975db req-b3111739-3b9f-48cf-b4fc-5ec9655ef350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a214da7a-8c90-48be-8343-ad8703669383", "name": "network-vif-deleted", "tag": "98e05ff3-166e-4ce6-8f09-e790bd4da7c9"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:52:09.816785 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-12ccf9dc-c097-468e-9f09-28db37e975db req-b3111739-3b9f-48cf-b4fc-5ec9655ef350 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:09.817223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-12ccf9dc-c097-468e-9f09-28db37e975db req-b3111739-3b9f-48cf-b4fc-5ec9655ef350 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:09.829191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-12ccf9dc-c097-468e-9f09-28db37e975db req-b3111739-3b9f-48cf-b4fc-5ec9655ef350 service nova] Creating event network-vif-deleted:98e05ff3-166e-4ce6-8f09-e790bd4da7c9 for instance a214da7a-8c90-48be-8343-ad8703669383 on hv-cinder-85044 Jul 21 05:52:09.834495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-12ccf9dc-c097-468e-9f09-28db37e975db req-b3111739-3b9f-48cf-b4fc-5ec9655ef350 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Jul 21 05:52:09.835170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 377/633] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:52:10.712060 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:10.712808 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] [instance: a214da7a-8c90-48be-8343-ad8703669383] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:10.720855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:10.721546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:10.722347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:10.722763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:10.736719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] HTTP exception thrown: Instance a214da7a-8c90-48be-8343-ad8703669383 could not be found. Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Request method failure captured: Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 HTTP/1.1 Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OlhFsMoalPQQsdP62Zvwqy1Rc3WVzi7Cr--SlZx_-sxobNd7IwHZ1tZMIUoMzzpnZaikMpCgHSJ3uAy8eIufqNOHSN-8fjxJY7hIpDT41l8qyaQVP5hxi-ITnfZ_7vOE5kSyEMydkcKkORqn1x1_jcUujnUvlDN2XPlugRzOiRcvJY Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 4a6ca476be674ec4a96993f135f66a80 Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesActionsTest-1909065468 Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:52:10.738379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/4a6ca476be674ec4a96993f135f66a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a6ca476be674ec4a96993f135f66a80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_4a6ca476be674ec4a96993f135f66a80", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/4a6ca476be674ec4a96993f135f66a80"}]}] Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesActionsTest-1909065468 Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 4a6ca476be674ec4a96993f135f66a80 Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesActionsTest-1909065468 Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesActionsTest-1909065468-project Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: ef4ed725d22a4826bd8c7ef0b8c4df67 Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesActionsTest-1909065468-project Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance a214da7a-8c90-48be-8343-ad8703669383 could not be found. Jul 21 05:52:10.740002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'a214da7a-8c90-48be-8343-ad8703669383'} Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a214da7a-8c90-48be-8343-ad8703669383 could not be found. Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:52:10.740838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a214da7a-8c90-48be-8343-ad8703669383 could not be found. Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a214da7a-8c90-48be-8343-ad8703669383 could not be found. Jul 21 05:52:10.742110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:52:10.743290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] Returning 404 to user: Instance a214da7a-8c90-48be-8343-ad8703669383 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:52:10.743290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-301a3342-ea28-441a-9670-2acf66103821 tempest-VolumesActionsTest-1909065468 tempest-VolumesActionsTest-1909065468-project] 10.222.0.44 "GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383" status: 404 len: 111 microversion: 2.1 time: 0.033835 Jul 21 05:52:10.743290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 378/634] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:10 2022] GET /compute/v2.1/servers/a214da7a-8c90-48be-8343-ad8703669383 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:52:25.131358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-613379463", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-541431774", "security_groups": [{"name": "tempest-secgroup-smoke-744981140"}], "networks": [{"uuid": "0ca9a5a4-3015-4d4b-84dd-d0b62ff1eea1"}], "block_device_mapping_v2": [{"uuid": "1c9385a4-fd87-4b8d-987a-a4b807c99dee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:52:25.142333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:25.143246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:25.264708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] validate_networks() for [('0ca9a5a4-3015-4d4b-84dd-d0b62ff1eea1', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:52:25.684825 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:52:25.685416 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:52:25.685995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:52:25.686471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:52:25.687728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:52:25.699530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:25.700123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:25.700928 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:25.701357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:25.723238 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Getting quotas for project 6c683289fa724e71bb7a9f69154c84a1. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:52:25.727927 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Getting quotas for user b894a36d43224aba9fc4b14b151e75b2 and project 6c683289fa724e71bb7a9f69154c84a1. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:52:25.789283 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:52:25.791513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c9385a4-fd87-4b8d-987a-a4b807c99dee',volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:52:25.944595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f1982d2e-e7e2-4040-8ba6-0010e70a3e91 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.817159 Jul 21 05:52:25.945500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 379/635] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:52:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 05:52:25.956056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ee5825e3-4105-41b1-8b31-85615c3ccaeb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:25.956700 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ee5825e3-4105-41b1-8b31-85615c3ccaeb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:26.021876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ee5825e3-4105-41b1-8b31-85615c3ccaeb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:26.030118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ee5825e3-4105-41b1-8b31-85615c3ccaeb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1087 microversion: 2.1 time: 0.078472 Jul 21 05:52:26.039063 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 380/636] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:25 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1087 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:27.050544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:27.051471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:27.075964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:27.075964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:27.080048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:27.080498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:27.183861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:27.215224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-38dda035-36b5-4b97-b01e-332956bad2e0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1193 microversion: 2.1 time: 0.168444 Jul 21 05:52:27.228905 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 381/637] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:27 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1193 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:28.240345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:28.241110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:28.261378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:28.261932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:28.262976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:28.263526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:28.607927 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:28.617723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8cc57024-c3cf-4ff5-8813-b8b0ff41249d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.381733 Jul 21 05:52:28.627844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 382/638] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:28 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:29.137467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-b6c1b728-f39a-40bb-9110-33583e83d666 req-f274f0a1-0e0c-4b8a-922e-4d072cc2de5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e229f5-22b2-4084-8cef-30070589917c", "tag": "fa8b9f49-d0a2-43fd-ac24-5bc695f065a8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:52:29.149128 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-b6c1b728-f39a-40bb-9110-33583e83d666 req-f274f0a1-0e0c-4b8a-922e-4d072cc2de5a service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:29.149784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-b6c1b728-f39a-40bb-9110-33583e83d666 req-f274f0a1-0e0c-4b8a-922e-4d072cc2de5a service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:29.167530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-b6c1b728-f39a-40bb-9110-33583e83d666 req-f274f0a1-0e0c-4b8a-922e-4d072cc2de5a service nova] Creating event network-changed:fa8b9f49-d0a2-43fd-ac24-5bc695f065a8 for instance 02e229f5-22b2-4084-8cef-30070589917c on hv-cinder-85044 Jul 21 05:52:29.174332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-b6c1b728-f39a-40bb-9110-33583e83d666 req-f274f0a1-0e0c-4b8a-922e-4d072cc2de5a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040418 Jul 21 05:52:29.175761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 383/639] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:52:29.635750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:29.636461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:29.643676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:29.644365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:29.645386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:29.646130 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:29.801670 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:29.809837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d52d67a0-41d2-4226-a0c1-37a2581e61ca tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.178520 Jul 21 05:52:29.810558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 384/640] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:29 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:30.828229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:30.829635 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:30.837263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:30.839526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:30.840598 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:30.841101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:31.114772 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:31.127770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0211b2ce-a84e-42bf-9c3d-9a73381a6128 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.302934 Jul 21 05:52:31.138128 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 385/641] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:30 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:32.146235 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:32.146894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:32.154110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:32.154555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:32.155620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:32.156589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:32.303171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:32.312371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cbd335e9-8cf4-45bd-a5ad-25f643c50cfc tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.170614 Jul 21 05:52:32.322353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 386/642] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:32 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:33.330218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:33.330876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:33.337830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:33.338273 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:33.339063 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:33.339492 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:33.487770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:33.498011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b6ed9f30-804e-4740-990b-74154b56c9b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.171988 Jul 21 05:52:33.498628 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 387/643] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:33 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:34.517535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:34.518965 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:34.529005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:34.529738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:34.531596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:34.532555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:34.697891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:34.709449 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-235e3fc6-91be-44fe-8eaa-fb79b2c2d7a0 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.198539 Jul 21 05:52:34.710359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 388/644] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:34 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:35.725821 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:35.727195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:35.731041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:35.734863 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:35.739062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:35.739062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:35.739062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:35.887881 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:35.895446 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e9031e56-6103-43c1-a79a-4fafc0013e13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.173444 Jul 21 05:52:35.896009 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 389/645] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:35 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:36.917092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:36.918165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:36.921004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=8 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:36.931459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:36.932191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:36.933452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:36.934183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:37.091527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:37.099501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c6201993-1e0a-4ce9-8eb0-a58d8dab331b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.189061 Jul 21 05:52:37.100064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 390/646] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:36 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:38.117709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:38.118363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:38.125401 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:38.125836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:38.126587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:38.127173 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:38.278211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:38.290587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5df7ddc6-55b5-452b-b802-41b2f488d95b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.177378 Jul 21 05:52:38.291482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 391/647] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:38 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:39.308931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:39.309553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:39.316299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:39.316811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:39.317578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:39.318033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:39.458418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:39.466658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-378bdbe1-864e-4493-be9e-cf73a4955b64 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.162828 Jul 21 05:52:39.467098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 392/648] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:39 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:40.483997 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:40.484655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:40.492164 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:40.492609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:40.493374 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:40.493809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:40.631437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:40.639191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cc00d0bb-78ab-4b36-9b92-b387710c514b tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.158994 Jul 21 05:52:40.639750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 393/649] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:40 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:41.657101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:41.658542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:41.666126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:41.666890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:41.667685 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:41.668111 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:41.801687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:41.809421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-60812ad2-75d7-4b21-aa47-a4cca134649a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.157441 Jul 21 05:52:41.809968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 394/650] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:41 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:52:41.814335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-c0cde276-6c56-4b73-8d5b-e81ef5bdecdc req-a071c52d-65d3-45cc-a935-d2404c724679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e229f5-22b2-4084-8cef-30070589917c", "name": "network-vif-plugged", "status": "completed", "tag": "fa8b9f49-d0a2-43fd-ac24-5bc695f065a8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:52:41.822269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-c0cde276-6c56-4b73-8d5b-e81ef5bdecdc req-a071c52d-65d3-45cc-a935-d2404c724679 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:41.822742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-c0cde276-6c56-4b73-8d5b-e81ef5bdecdc req-a071c52d-65d3-45cc-a935-d2404c724679 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:41.833716 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-c0cde276-6c56-4b73-8d5b-e81ef5bdecdc req-a071c52d-65d3-45cc-a935-d2404c724679 service nova] Creating event network-vif-plugged:fa8b9f49-d0a2-43fd-ac24-5bc695f065a8 for instance 02e229f5-22b2-4084-8cef-30070589917c on hv-cinder-85044 Jul 21 05:52:41.838731 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-c0cde276-6c56-4b73-8d5b-e81ef5bdecdc req-a071c52d-65d3-45cc-a935-d2404c724679 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027600 Jul 21 05:52:41.839501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 395/651] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:52:42.827550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:42.828250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:42.834935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:42.835431 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:42.836191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:42.836620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:42.975603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:42.986289 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c4e31cad-b0e8-45a4-8eca-da7db891f413 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.163265 Jul 21 05:52:42.987052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 396/652] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:42 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:44.008240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:44.009248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:44.019964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:44.020706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:44.022000 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:44.022764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:44.169330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:44.182195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-edbf9fa2-c9a6-47aa-b078-c093f96d4b80 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.180223 Jul 21 05:52:44.183177 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 397/653] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:44 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:45.204439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:45.206176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:45.214483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:45.214920 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:45.215700 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:45.216125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:45.235264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:52:45.359866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:45.367786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cf4ac5a1-a087-4b75-9afc-93bb3ac6b93e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.170302 Jul 21 05:52:45.368345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 398/654] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:45 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:46.387943 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:46.388863 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:46.398664 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:46.399366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:46.400453 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:46.401071 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:46.534709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:46.542701 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1a5fb7b3-36dd-4100-8d94-3b70100a1c53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1258 microversion: 2.1 time: 0.160466 Jul 21 05:52:46.543275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 399/655] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:46 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:47.560104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:47.560803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:47.567814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:47.568253 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:47.569003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:47.569430 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:47.709583 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:47.718332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6faf2aa2-35ab-4011-899c-bc67d345a9c1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1442 microversion: 2.1 time: 0.162193 Jul 21 05:52:47.718901 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 400/656] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:47 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:47.745018 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:52:47.745872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:52:47.756016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:47.756459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:47.757226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:47.757658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:47.902827 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:52:47.911279 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c5f1c878-add3-40af-8270-f8fc7ffd7bb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1442 microversion: 2.1 time: 0.174906 Jul 21 05:52:47.911860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 401/657] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:52:47 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1442 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:52:49.995795 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-e6632070-ffe5-453a-b9fc-44e333ead95f req-46d56151-a17e-4afa-a724-8ada5e723a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e229f5-22b2-4084-8cef-30070589917c", "tag": "fa8b9f49-d0a2-43fd-ac24-5bc695f065a8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:52:50.005040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e6632070-ffe5-453a-b9fc-44e333ead95f req-46d56151-a17e-4afa-a724-8ada5e723a38 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:52:50.005480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e6632070-ffe5-453a-b9fc-44e333ead95f req-46d56151-a17e-4afa-a724-8ada5e723a38 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:52:50.017116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-e6632070-ffe5-453a-b9fc-44e333ead95f req-46d56151-a17e-4afa-a724-8ada5e723a38 service nova] Creating event network-changed:fa8b9f49-d0a2-43fd-ac24-5bc695f065a8 for instance 02e229f5-22b2-4084-8cef-30070589917c on hv-cinder-85044 Jul 21 05:52:50.022535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-e6632070-ffe5-453a-b9fc-44e333ead95f req-46d56151-a17e-4afa-a724-8ada5e723a38 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031383 Jul 21 05:52:50.023163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 402/658] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:53:04.699411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:04.700176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=22 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:04.704850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:04.705635 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:04.714045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:04.714482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:04.715283 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:04.715692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:04.740295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:53:04.818552 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ad26680a-b48c-4ad2-86a7-fc4fbd98b9fb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "DELETE /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 204 len: 0 microversion: 2.1 time: 0.120424 Jul 21 05:53:04.819380 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 403/659] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:53:04 2022] DELETE /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:53:04.828174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:04.828875 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:04.834967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:04.835449 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:04.836214 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:04.836649 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:04.986031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:04.998224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f1db6164-cf86-4e3d-b44a-b30a88339d4f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1577 microversion: 2.1 time: 0.173802 Jul 21 05:53:04.998999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 404/660] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:04 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:53:06.022744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:06.023769 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:06.030906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:06.031739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:06.032510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:06.032949 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:06.174824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:06.183410 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4542d220-ef17-4867-bb8f-056ce76f9d3d tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1577 microversion: 2.1 time: 0.167291 Jul 21 05:53:06.183952 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 405/661] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:06 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:07.201335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:07.201942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:07.211528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:07.212707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:07.214436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:07.215183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:07.412777 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:07.420861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fd539c24-9011-4e21-aff9-ecfa41056b3f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1577 microversion: 2.1 time: 0.223631 Jul 21 05:53:07.421420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 406/662] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:07 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:07.728906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-960ff6bc-f162-498a-855f-76550ba7be5a req-c0db87b4-bc6c-4cf0-a9e3-69e948026da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119674ff-e339-4ec5-9d00-18ad40d627c3", "name": "network-vif-deleted", "tag": "b45347c6-78c0-44d3-8334-be006a63c355"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:07.738678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-960ff6bc-f162-498a-855f-76550ba7be5a req-c0db87b4-bc6c-4cf0-a9e3-69e948026da8 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:07.739143 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-960ff6bc-f162-498a-855f-76550ba7be5a req-c0db87b4-bc6c-4cf0-a9e3-69e948026da8 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:07.751238 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-960ff6bc-f162-498a-855f-76550ba7be5a req-c0db87b4-bc6c-4cf0-a9e3-69e948026da8 service nova] Creating event network-vif-deleted:b45347c6-78c0-44d3-8334-be006a63c355 for instance 119674ff-e339-4ec5-9d00-18ad40d627c3 on hv-cinder-85044 Jul 21 05:53:07.756033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-960ff6bc-f162-498a-855f-76550ba7be5a req-c0db87b4-bc6c-4cf0-a9e3-69e948026da8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Jul 21 05:53:07.757003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 407/663] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:53:08.438322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:08.439049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:08.446137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:08.446598 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:08.447418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:08.447846 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:08.479691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:08.480161 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:08.480602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lazy-loading 'fault' on Instance uuid 119674ff-e339-4ec5-9d00-18ad40d627c3 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:53:08.529217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:08.538971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-91d756eb-564e-490e-9882-023c8a9d4851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 200 len: 1229 microversion: 2.1 time: 0.104679 Jul 21 05:53:08.540123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 408/664] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:08 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:53:09.560678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:09.561752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:09.571860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:09.572305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:09.573070 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:09.573543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:09.587495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] HTTP exception thrown: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Request method failure captured: Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 HTTP/1.1 Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OkBAyzXMXVOyXlNqf3WjnGrna9lyHWaG73PVmGhx44gAxUfXk7H1ejGqZ7L0amJhbdap4Xbpz1AT5GOn4O2qUEHfJdv6Kiwov7hLWaH-llQ8VJAzE3YuIyQXIXnjg-5--iKV38E_IAk72ZLHEWSeDuMUeiTwAc4Xo1MPUUl7-1wRC0 Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:53:09.589138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c6f9207778b4e0fbdbbae28c8f7b224", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}] Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestVolumeBootPattern-552124233 Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 17108265cfba44b29c362ac18bbf3e20 Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:53:09.590689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '119674ff-e339-4ec5-9d00-18ad40d627c3'} Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:53:09.591606 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:53:09.592892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:53:09.594005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Returning 404 to user: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:53:09.594005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5b3f81ea-0d0b-4510-80f4-c77680c3d58b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 404 len: 111 microversion: 2.1 time: 0.036556 Jul 21 05:53:09.594005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 409/665] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:09 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:53:09.816340 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-209828790", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-179865322", "security_groups": [{"name": "tempest-secgroup-smoke-1102999197"}], "block_device_mapping_v2": [{"uuid": "0afdc9cd-f33c-429e-8b01-f8b59eb69213", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d24dd506-b76c-4cd5-b8bb-2127b1812879"}]}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:09.930393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] validate_networks() for [('d24dd506-b76c-4cd5-b8bb-2127b1812879', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:53:10.313137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:53:10.313560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:53:10.314036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:53:10.314433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:53:10.314874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:53:10.324631 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:10.325081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:10.325874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:10.326307 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:10.343217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:53:10.347333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for user 17108265cfba44b29c362ac18bbf3e20 and project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:53:10.404263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:53:10.406713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0afdc9cd-f33c-429e-8b01-f8b59eb69213',volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:53:10.543568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f44add1e-a89d-498f-9a46-0f6e45d5d22f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.731211 Jul 21 05:53:10.544240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 410/666] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:53:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 05:53:10.553859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4b8f5c7c-4999-4491-bd7f-68b6b8f9282b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:10.554716 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4b8f5c7c-4999-4491-bd7f-68b6b8f9282b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:10.608405 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4b8f5c7c-4999-4491-bd7f-68b6b8f9282b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:10.615581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4b8f5c7c-4999-4491-bd7f-68b6b8f9282b tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1093 microversion: 2.1 time: 0.065306 Jul 21 05:53:10.616095 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 411/667] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:10 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:11.632749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:11.633456 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:11.641109 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:11.641559 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:11.642337 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:11.642770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:11.732284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:11.742100 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6100f721-e5da-409c-a5d0-f15450801851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1199 microversion: 2.1 time: 0.113262 Jul 21 05:53:11.742910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 412/668] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:11 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1199 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:12.759158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:12.759860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:12.766726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:12.767289 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:12.768130 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:12.768631 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:13.016632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:13.025623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b3513b93-24ad-4310-a99f-826bbf6e1823 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.270514 Jul 21 05:53:13.026520 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 413/669] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:12 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:13.164383 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-3b373156-8f88-480a-bdd8-d6af8956be1a req-612735c6-6b70-431d-9b79-a529a9ad5560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f7266ba-ea2e-43e6-b10c-313112fee2b0", "tag": "e5ae2355-4951-40f9-95fe-f387622b53fb"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:13.174359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-3b373156-8f88-480a-bdd8-d6af8956be1a req-612735c6-6b70-431d-9b79-a529a9ad5560 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:13.174806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-3b373156-8f88-480a-bdd8-d6af8956be1a req-612735c6-6b70-431d-9b79-a529a9ad5560 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:13.192741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-3b373156-8f88-480a-bdd8-d6af8956be1a req-612735c6-6b70-431d-9b79-a529a9ad5560 service nova] Creating event network-changed:e5ae2355-4951-40f9-95fe-f387622b53fb for instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 on hv-cinder-85044 Jul 21 05:53:13.198438 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-3b373156-8f88-480a-bdd8-d6af8956be1a req-612735c6-6b70-431d-9b79-a529a9ad5560 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037616 Jul 21 05:53:13.199001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 414/670] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:53:14.046108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:14.046977 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:14.055213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:14.055765 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:14.056706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:14.057247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:14.193494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:14.201387 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-628a3725-a29b-4e1b-86b1-4bec5c2223b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.160589 Jul 21 05:53:14.201947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 415/671] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:14 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:15.217959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:15.218659 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:15.225822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:15.226260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:15.227043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:15.227512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:15.371099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:15.378939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d383d81e-032b-418d-8132-9c94692f05ab tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.164881 Jul 21 05:53:15.379465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 416/672] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:15 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:16.400339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:16.401368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:16.412635 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:16.413373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:16.414412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:16.414847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:16.562907 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:16.570618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f2cba5a2-2e5a-459b-a9a1-9f780fbb51da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.176983 Jul 21 05:53:16.571208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 417/673] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:16 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:17.590424 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:17.591251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:17.599166 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:17.599689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:17.600569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:17.601071 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:17.736843 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:17.748184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5e1371c1-4f40-4f84-9b41-ba4b196f6fe3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.162627 Jul 21 05:53:17.748801 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 418/674] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:17 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:18.771358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:18.772414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:18.779730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:18.780180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:18.781310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:18.781737 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:18.922157 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:18.930104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b889c377-ef23-42fc-aa3b-d2f3b48a3e99 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.165299 Jul 21 05:53:18.930672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 419/675] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:18 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:19.785697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-431d4c01-fbd0-4c29-a8b5-ff159f787c13 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:19.786646 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-431d4c01-fbd0-4c29-a8b5-ff159f787c13 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:19.797641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-431d4c01-fbd0-4c29-a8b5-ff159f787c13 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:19.798371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-431d4c01-fbd0-4c29-a8b5-ff159f787c13 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:19.801555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-431d4c01-fbd0-4c29-a8b5-ff159f787c13 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:19.801555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-431d4c01-fbd0-4c29-a8b5-ff159f787c13 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:19.827041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-431d4c01-fbd0-4c29-a8b5-ff159f787c13 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/ips" status: 200 len: 151 microversion: 2.20 time: 0.048342 Jul 21 05:53:19.827625 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 420/676] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jul 21 05:53:19 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:53:19.946663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:19.947308 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:19.953755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:19.954204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:19.954974 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:19.955445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:19.974505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:20.093620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:20.102390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-604edc44-5325-4322-8611-5253a26341db tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.159631 Jul 21 05:53:20.103385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 421/677] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:19 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:21.121282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:21.121995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:21.124073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:21.124984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=8 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:21.131450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:21.131939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:21.132786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:21.133263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:21.277691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:21.285987 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a8cc821b-f880-4c16-8172-c4d02edeb6be tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.169156 Jul 21 05:53:21.286567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 422/678] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:21 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:53:21.841798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:21.842335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:21.848797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:21.849241 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:21.850004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:21.850434 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:21.873701 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lazy-loading 'flavor' on Instance uuid 7775f455-5795-417b-9527-5541344dead1 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:53:22.145655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-10efea4e-347f-4545-b179-42ff72c07a24 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/action" status: 202 len: 0 microversion: 2.20 time: 0.307779 Jul 21 05:53:22.146413 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 423/679] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jul 21 05:53:21 2022] POST /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:53:22.154841 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:22.155591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:22.163400 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:22.163831 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:22.164802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:22.165213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:22.313121 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:22.321554 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:22.323116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:22.324272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6c558ac7-cb64-4630-97a1-03204bbdfb68 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.173391 Jul 21 05:53:22.324833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 424/680] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:22 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:22.329136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:22.329736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:22.335536 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:22.335987 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:22.336751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:22.337180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:22.473731 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:22.482420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ed2f9086-e2e2-49ca-b6c2-4d3310921993 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.156567 Jul 21 05:53:22.483264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 425/681] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:22 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:23.347630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:23.348841 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:23.359792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:23.360544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:23.361812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:23.362594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:23.504043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:23.514632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:23.516158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:23.517318 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f39cb9d1-b496-4617-93a7-b2f5e7674e6d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.176296 Jul 21 05:53:23.517852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 426/682] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:23 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:23.522952 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:23.523584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:23.529443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:23.529894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:23.530658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:23.531487 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:23.667839 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:23.675827 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5729afc3-8633-4889-94bc-f228fe500410 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.157026 Jul 21 05:53:23.676384 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 427/683] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:23 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:23.971220 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-1f6b61fd-9b69-445f-a81c-026862675f4b req-f27913ed-e64b-4013-a0fc-1c9cbea15f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f7266ba-ea2e-43e6-b10c-313112fee2b0", "name": "network-vif-plugged", "status": "completed", "tag": "e5ae2355-4951-40f9-95fe-f387622b53fb"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:23.979823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1f6b61fd-9b69-445f-a81c-026862675f4b req-f27913ed-e64b-4013-a0fc-1c9cbea15f50 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:23.980248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1f6b61fd-9b69-445f-a81c-026862675f4b req-f27913ed-e64b-4013-a0fc-1c9cbea15f50 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:23.992701 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-1f6b61fd-9b69-445f-a81c-026862675f4b req-f27913ed-e64b-4013-a0fc-1c9cbea15f50 service nova] Creating event network-vif-plugged:e5ae2355-4951-40f9-95fe-f387622b53fb for instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 on hv-cinder-85044 Jul 21 05:53:23.997621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-1f6b61fd-9b69-445f-a81c-026862675f4b req-f27913ed-e64b-4013-a0fc-1c9cbea15f50 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030411 Jul 21 05:53:23.998411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 428/684] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:53:24.541543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:24.542267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:24.550535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:24.551060 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:24.551958 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:24.552458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:24.693689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:24.702450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:24.703995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:24.705154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4d73f31e-b0aa-4f89-96f1-649ffdfbb3dd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.170764 Jul 21 05:53:24.705693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 429/685] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:24 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:24.709994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:24.710624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:24.716750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:24.717191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:24.717953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:24.718422 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:24.858024 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:24.865889 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-508ca191-bc7e-4970-8514-38354aef55ad tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.159226 Jul 21 05:53:24.866448 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 430/686] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:24 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:25.726912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:25.727968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:25.739100 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:25.739894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:25.741210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:25.741929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:25.879593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:25.888072 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:25.889562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:25.890715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4abf4960-1817-410f-9ad3-221f7d4247a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.170471 Jul 21 05:53:25.891479 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 431/687] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:25 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:25.895764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:25.896368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:25.902615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:25.903133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:25.903899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:25.904303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:26.038106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:26.046055 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8ff14dec-2488-41ad-b547-a5873c7679e9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1265 microversion: 2.1 time: 0.153637 Jul 21 05:53:26.046616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 432/688] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:25 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:26.914304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:26.915290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:26.923174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:26.923562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:26.924354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:26.924784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:27.063957 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:27.072057 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:27.073576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:27.074722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-809ffb6d-2511-4905-bb12-0fa79968a806 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.167032 Jul 21 05:53:27.075325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 433/689] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:26 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:27.079624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:27.080247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:27.086532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:27.087039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:27.087806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:27.088244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:27.220129 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:27.231994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a5759d60-4c5d-4ab2-a122-a9d5e7fc5972 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1452 microversion: 2.1 time: 0.155422 Jul 21 05:53:27.232786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 434/690] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:27 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:53:27.252708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:27.253302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:27.259420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:27.259857 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:27.260617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:27.261042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:27.400205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:27.412332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-448733ed-e38e-4214-83dd-0c47880165bf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1452 microversion: 2.1 time: 0.162905 Jul 21 05:53:27.413177 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 435/691] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:53:27 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:53:28.093654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:28.094369 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:28.101744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:28.102195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:28.102976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:28.103477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:28.340103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:28.343866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:28.349103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:28.350585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:28.352007 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-41575303-0730-463c-82a3-2e78546b2fe1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.262433 Jul 21 05:53:28.352571 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 436/692] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:28 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:29.089243 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-ca1f6816-46ff-466b-88ab-85f4cc3def4e req-e936740a-1562-4e7f-b50c-f77bf24e9c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f7266ba-ea2e-43e6-b10c-313112fee2b0", "tag": "e5ae2355-4951-40f9-95fe-f387622b53fb"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:29.098084 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-ca1f6816-46ff-466b-88ab-85f4cc3def4e req-e936740a-1562-4e7f-b50c-f77bf24e9c0b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:29.098727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-ca1f6816-46ff-466b-88ab-85f4cc3def4e req-e936740a-1562-4e7f-b50c-f77bf24e9c0b service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:29.111563 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-ca1f6816-46ff-466b-88ab-85f4cc3def4e req-e936740a-1562-4e7f-b50c-f77bf24e9c0b service nova] Creating event network-changed:e5ae2355-4951-40f9-95fe-f387622b53fb for instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 on hv-cinder-85044 Jul 21 05:53:29.116527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-ca1f6816-46ff-466b-88ab-85f4cc3def4e req-e936740a-1562-4e7f-b50c-f77bf24e9c0b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030983 Jul 21 05:53:29.117190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 437/693] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:53:29.372332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:29.373029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:29.379489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:29.380177 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:29.380944 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:29.381372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:29.579226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:29.588192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:29.589906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:29.591269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ffaf54a8-4f64-4913-9b36-0dd0a0b78f11 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.223300 Jul 21 05:53:29.591914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 438/694] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:29 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:30.611469 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:30.612304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:30.618842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:30.620792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:30.621239 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:30.622029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:30.622464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:30.763710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:30.776019 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:30.778168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:30.779978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1cdbb86d-a9a1-43e8-b03b-9158e210cca7 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.172139 Jul 21 05:53:30.780536 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 439/695] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:30 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:31.802370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:31.803370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:31.814697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:31.815495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:31.816752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:31.817473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:32.203006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:32.211291 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:32.212799 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:32.213955 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-743e2a07-631d-490a-bcb8-d1b0f80131cd tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.418252 Jul 21 05:53:32.214521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 440/696] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:31 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:53:33.235515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:33.236209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:33.243224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:33.243674 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:33.244439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:33.244870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:33.375433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:33.383722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:33.385196 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:33.386404 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e62a9700-65b2-4222-8829-31ff83717c62 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.156190 Jul 21 05:53:33.386964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 441/697] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:33 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:34.409951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:34.411117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:34.422036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:34.422762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:34.424089 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:34.424754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:34.560958 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:34.569114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:34.570599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:34.571835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-97260999-0fc6-4b1e-bd78-19b2e903798d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.169073 Jul 21 05:53:34.572422 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 442/698] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:34 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:35.590117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:35.590770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:35.597785 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:35.598227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:35.598980 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:35.599443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:35.734014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:35.742474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:35.743984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:35.745136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2c6b6992-63da-4591-85a4-8d71b2b568d1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.159206 Jul 21 05:53:35.745699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 443/699] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:35 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:36.767282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:36.768261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:36.779272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:36.780003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:36.781675 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:36.782101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:36.924364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:36.932508 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:36.934001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:36.935184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cf1f6f8c-c840-4a4c-97cb-ed540017d13c tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.174521 Jul 21 05:53:36.935748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 444/700] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:36 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:37.955471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:37.956091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:37.963104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:37.963554 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:37.964349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:37.964758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:38.105096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:38.117273 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:38.119753 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:38.121564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ac79d9e3-c208-4073-adf8-e3fa62a60540 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.170537 Jul 21 05:53:38.122461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 445/701] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:37 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:39.144855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:39.145954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:39.157086 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:39.157546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:39.158293 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:39.158722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:39.300593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:39.313028 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:39.315458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:39.317295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1554f7d8-d349-4d0b-95ca-1d550567edc1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1742 microversion: 2.20 time: 0.179016 Jul 21 05:53:39.318106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 446/702] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:39 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1742 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:40.336333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:40.336978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:40.343801 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:40.344275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:40.345033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:40.345564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:40.637059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:40.647217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:40.648763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:40.649929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-886b1052-1306-4f36-903a-d5819d5b21cc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1742 microversion: 2.20 time: 0.317605 Jul 21 05:53:40.650496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 447/703] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:40 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1742 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:41.672842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:41.673810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:41.681534 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:41.681978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:41.682738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:41.683209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:41.816496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:41.824818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:41.826302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:41.827548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d56eeca6-dcee-44f0-97ad-0fd79e49edac tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1742 microversion: 2.20 time: 0.161231 Jul 21 05:53:41.828112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 448/704] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:41 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:41.993913 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-0515d7c4-3d7c-4f56-a647-31bfe5710a72 req-4d2111d9-98cd-49f0-86f8-b2471d9a80cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7775f455-5795-417b-9527-5541344dead1", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7fbe9-4495-4de8-b167-ed4d5ac257d8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:42.002491 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0515d7c4-3d7c-4f56-a647-31bfe5710a72 req-4d2111d9-98cd-49f0-86f8-b2471d9a80cf service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:42.002929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0515d7c4-3d7c-4f56-a647-31bfe5710a72 req-4d2111d9-98cd-49f0-86f8-b2471d9a80cf service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:42.014129 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-0515d7c4-3d7c-4f56-a647-31bfe5710a72 req-4d2111d9-98cd-49f0-86f8-b2471d9a80cf service nova] Creating event network-vif-plugged:d2b7fbe9-4495-4de8-b167-ed4d5ac257d8 for instance 7775f455-5795-417b-9527-5541344dead1 on hv-cinder-85044 Jul 21 05:53:42.019132 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-0515d7c4-3d7c-4f56-a647-31bfe5710a72 req-4d2111d9-98cd-49f0-86f8-b2471d9a80cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028896 Jul 21 05:53:42.019726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 449/705] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:53:42.849019 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:42.849729 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:42.857328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:42.857865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:42.858787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:42.859374 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:42.997771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:43.006058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:43.007581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:43.008723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fd23a42b-73ad-45c2-9935-896c8c7d9b48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1742 microversion: 2.20 time: 0.165827 Jul 21 05:53:43.009284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 450/706] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:42 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1742 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:44.027389 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:44.028061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:44.035071 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:44.035527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:44.036297 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:44.036727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:44.174948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:44.183438 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:44.185204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:44.186529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-afdc684a-0cd9-463e-a668-36c44c76ca5a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.163226 Jul 21 05:53:44.187633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 451/707] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:44 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:45.205953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:45.206783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:45.213916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:45.214366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:45.215168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:45.215605 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:45.360904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:45.370109 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:45.371878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:45.373073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c8535c85-df0a-485c-9ca2-a236de85321e tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.171183 Jul 21 05:53:45.373819 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 452/708] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:45 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:53:46.535723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:46.536329 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:46.542858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:46.543329 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:46.544102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:46.544531 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:46.686784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:46.701357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:46.705324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:46.707900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5da857dc-fc4e-4e14-bf74-8a0be9db7343 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.319408 Jul 21 05:53:46.708891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 453/709] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:46 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:47.727376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:47.728184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:47.737351 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:47.737797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:47.738574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:47.739024 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:47.877195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:47.881305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:47.888459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:47.889960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:47.891260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-94bdfefb-2eb8-4221-b79a-fd328ccd2027 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.168420 Jul 21 05:53:47.892142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 454/710] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:47 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:48.910362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:48.911082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:48.918305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:48.918675 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:48.919474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:48.919885 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:49.062480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:49.072429 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:49.073962 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:49.075262 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d1032236-37ef-4fbf-9c10-741a09c588ed tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.168842 Jul 21 05:53:49.086228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 455/711] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:48 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:53:50.095762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:50.097622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:50.105419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:50.105866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:50.106656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:50.107148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:50.252978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:50.261359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:50.262842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:50.263978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dc3ebdec-37b3-4093-8c5d-761604030a77 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.173585 Jul 21 05:53:50.275067 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 456/712] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:50 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:51.282573 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:51.283430 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:51.290706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:51.291277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:51.292220 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:51.292717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:51.436098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:51.444622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:51.446209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:51.447437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0ec79467-8055-4a00-869e-cd6f0f2b0826 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.169307 Jul 21 05:53:51.454118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 457/713] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:51 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:52.470266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:52.471435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:52.478687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:52.479570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:52.479826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:52.480235 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:52.614375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:52.622895 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:52.624449 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:52.625611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1f891285-fe96-4db6-a113-3e37f1f9414a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.161800 Jul 21 05:53:52.637073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 458/714] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:52 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:53.647581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:53.648252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:53.655381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:53.656264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:53.657033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:53.657462 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:53.791333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:53.801475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:53.802981 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:53.804159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-adb095bd-3232-4fd8-93a6-22c92d572528 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1737 microversion: 2.20 time: 0.162076 Jul 21 05:53:53.804720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 459/715] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:53 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:54.826363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:54.827106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:54.833619 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:54.834064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:54.834822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:54.835280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:54.981966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:54.990328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:54.991931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:54.993074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d3d3efbe-5f91-42c0-b961-2b929f9416aa tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1719 microversion: 2.20 time: 0.170762 Jul 21 05:53:54.993648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 460/716] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:54 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:56.011832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:56.012494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:56.019334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:56.019784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:56.020708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:56.020980 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:56.152994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:56.161717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:56.163277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:56.164462 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0a3cf1a8-352d-4d73-8ea3-5130ddbd442d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1719 microversion: 2.20 time: 0.156641 Jul 21 05:53:56.165002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 461/717] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:56 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:56.169328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-9c2bb1bf-66bd-4fd1-9a92-83b04943a513 req-038dddaa-4e03-428a-b8fd-5cd37d555612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7775f455-5795-417b-9527-5541344dead1", "name": "network-vif-unplugged", "status": "completed", "tag": "d2b7fbe9-4495-4de8-b167-ed4d5ac257d8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:56.177388 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-9c2bb1bf-66bd-4fd1-9a92-83b04943a513 req-038dddaa-4e03-428a-b8fd-5cd37d555612 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:56.177829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-9c2bb1bf-66bd-4fd1-9a92-83b04943a513 req-038dddaa-4e03-428a-b8fd-5cd37d555612 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:56.189059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-9c2bb1bf-66bd-4fd1-9a92-83b04943a513 req-038dddaa-4e03-428a-b8fd-5cd37d555612 service nova] Creating event network-vif-unplugged:d2b7fbe9-4495-4de8-b167-ed4d5ac257d8 for instance 7775f455-5795-417b-9527-5541344dead1 on hv-cinder-85044 Jul 21 05:53:56.194618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-9c2bb1bf-66bd-4fd1-9a92-83b04943a513 req-038dddaa-4e03-428a-b8fd-5cd37d555612 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028472 Jul 21 05:53:56.195206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 462/718] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:53:57.188816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:57.189939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:57.200633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:57.201375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:57.202621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:57.203417 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:57.340260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:57.348598 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:57.350116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:57.351298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b4c355be-5d6f-4f49-90f7-d5fdb16cbebb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1662 microversion: 2.20 time: 0.170403 Jul 21 05:53:57.351858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 463/719] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:57 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1662 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:53:57.369370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2099d3a7-f462-49e2-9dc1-74e55d7e25a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90e3566a-2d56-4a95-b889-5c2362f1eb59"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:57.370411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2099d3a7-f462-49e2-9dc1-74e55d7e25a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:57.376743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2099d3a7-f462-49e2-9dc1-74e55d7e25a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:57.377185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2099d3a7-f462-49e2-9dc1-74e55d7e25a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:57.377946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2099d3a7-f462-49e2-9dc1-74e55d7e25a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:57.378372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2099d3a7-f462-49e2-9dc1-74e55d7e25a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:57.674761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2099d3a7-f462-49e2-9dc1-74e55d7e25a6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309059 Jul 21 05:53:57.675385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 464/720] 10.222.0.44 () {62 vars in 1363 bytes} [Thu Jul 21 05:53:57 2022] POST /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 05:53:57.797027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5c03b16b-d754-46bc-97b3-7befe429a0ad tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:57.797555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5c03b16b-d754-46bc-97b3-7befe429a0ad tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:57.804623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c03b16b-d754-46bc-97b3-7befe429a0ad tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:57.805076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c03b16b-d754-46bc-97b3-7befe429a0ad tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:57.805829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c03b16b-d754-46bc-97b3-7befe429a0ad tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:57.806264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c03b16b-d754-46bc-97b3-7befe429a0ad tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:58.063167 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5c03b16b-d754-46bc-97b3-7befe429a0ad tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-volume_attachments/90e3566a-2d56-4a95-b889-5c2362f1eb59" status: 202 len: 0 microversion: 2.20 time: 0.269142 Jul 21 05:53:58.064066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 465/721] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jul 21 05:53:57 2022] DELETE /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-volume_attachments/90e3566a-2d56-4a95-b889-5c2362f1eb59 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:53:58.120934 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-97ffb141-7e1f-4248-a9bf-1de3c9b4b630 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:53:58.121644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-97ffb141-7e1f-4248-a9bf-1de3c9b4b630 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:58.129999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97ffb141-7e1f-4248-a9bf-1de3c9b4b630 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:58.129999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97ffb141-7e1f-4248-a9bf-1de3c9b4b630 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:58.129999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97ffb141-7e1f-4248-a9bf-1de3c9b4b630 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:58.130365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-97ffb141-7e1f-4248-a9bf-1de3c9b4b630 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:58.173840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:53:58.208623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-97ffb141-7e1f-4248-a9bf-1de3c9b4b630 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "POST /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/action" status: 202 len: 0 microversion: 2.20 time: 0.092260 Jul 21 05:53:58.209314 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 466/722] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jul 21 05:53:58 2022] POST /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 21 05:53:58.217143 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:58.217887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:58.224202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:58.224674 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:58.225442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:58.225872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:58.363866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:58.371791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:58.373282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:58.374435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f6fc8458-b4f5-4667-bfb9-c742d21a3880 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1670 microversion: 2.20 time: 0.161122 Jul 21 05:53:58.374999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 467/723] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:58 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:53:59.394553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:53:59.395357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:53:59.402158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:59.402599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:59.403390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:53:59.403796 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:53:59.538870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:59.550962 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:59.552608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:53:59.553750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2dc2bc04-1717-4159-b014-6b56b66a9cf9 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.164618 Jul 21 05:53:59.554284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 468/724] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:53:59 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:00.572735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:00.573456 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:00.579804 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:00.580239 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:00.581085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:00.581547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:00.740143 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:00.750943 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:00.752961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:00.754944 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e21432bb-d593-4e47-9d22-341aae667ef5 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.185864 Jul 21 05:54:00.770140 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 469/725] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:00 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:01.778527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:01.779284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:01.781855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=63 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:54:01.787735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:01.788185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:01.788951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:01.789381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:02.099720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:02.108336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:02.109926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:02.111222 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-31833aa9-e5dc-45ea-b85c-b4488d48500a tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.336727 Jul 21 05:54:02.111855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 470/726] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:01 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:54:03.132833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:03.134835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:03.142389 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:03.142844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:03.143662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:03.144090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:03.284299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:03.292600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:03.294192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:03.295430 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-420affa9-f0da-4bb2-b546-9d0742916ee8 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.168894 Jul 21 05:54:03.296251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 471/727] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:03 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:54:04.320107 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:04.320787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:04.327182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:04.327639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:04.328418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:04.328852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:04.468593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:04.477213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:04.478637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:04.479822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-adfde268-24c4-4007-8768-4f60d07c8e40 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.164543 Jul 21 05:54:04.480371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 472/728] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:04 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:05.501746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:05.502457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:05.510393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:05.510828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:05.511643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:05.512027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:05.649576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:05.660715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:05.665150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:05.667312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3fee2101-db5f-4c60-90d3-8d11e2dab3e6 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.172213 Jul 21 05:54:05.668103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 473/729] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:05 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:06.686002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:06.686771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:06.693943 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:06.694478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:06.695365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:06.695920 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:06.835813 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:06.843823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:06.845310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:06.846471 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6eb6ad8f-971a-470d-9273-2048302551a1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.164449 Jul 21 05:54:06.847065 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 474/730] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:06 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:54:07.867747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:07.868432 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:07.875363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:07.875815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:07.876603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:07.877039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:08.042527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:08.051355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:08.052864 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:08.054036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-480f049c-5602-4448-9734-d5be0a2aa7e1 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.190621 Jul 21 05:54:08.054600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 475/731] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:07 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:09.077012 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:09.078016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:09.087208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:09.087682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:09.088461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:09.088887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:09.219748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:09.228101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:09.229577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:09.230743 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-530f25bf-6034-4b33-b940-06f12cd6269b tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.160359 Jul 21 05:54:09.231345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 476/732] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:09 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:10.253689 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:10.254710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:10.263382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:10.263941 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:10.265044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:10.265552 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:10.402133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:10.411334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:10.412833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:10.414126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2e5b8992-db03-462c-946b-3e40dfd237db tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.167251 Jul 21 05:54:10.414686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 477/733] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:10 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:11.437129 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:11.438216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:11.449344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:11.450090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:11.451420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:11.452142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:11.584551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:11.592854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:11.594362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:11.595558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1f76c36c-d499-4e1b-8ad5-e25fcdf1ed48 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.165059 Jul 21 05:54:11.596125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 478/734] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:11 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:12.615058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:12.615887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:12.623814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:12.624339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:12.625217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:12.625716 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:12.757864 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:12.766020 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:12.767552 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:12.768708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-91e67000-96a9-4779-bc3b-f9515a86b876 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.158341 Jul 21 05:54:12.769353 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 479/735] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:12 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:13.792018 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:13.793108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:13.802634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:13.803085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:13.803866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:13.804298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:13.944932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:13.953385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:13.954872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:13.956057 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e1137ca2-e1c1-450e-84e8-4960cc1b5bea tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.170997 Jul 21 05:54:13.956619 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 480/736] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:13 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:14.978775 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:14.979911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:14.990887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:14.991696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:14.992962 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:14.993681 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:15.140625 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:15.150273 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:15.151808 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:15.152956 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-aaae3f2d-ddc4-4df3-8741-61e486610c92 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.180892 Jul 21 05:54:15.153536 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 481/737] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:14 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:16.171157 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-1a8a2bc7-c570-409c-aeb7-a672758d049d req-4dff5f63-25cb-4fde-988f-778f71387433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7775f455-5795-417b-9527-5541344dead1", "name": "network-vif-plugged", "status": "completed", "tag": "d2b7fbe9-4495-4de8-b167-ed4d5ac257d8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:54:16.181475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1a8a2bc7-c570-409c-aeb7-a672758d049d req-4dff5f63-25cb-4fde-988f-778f71387433 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:16.182093 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1a8a2bc7-c570-409c-aeb7-a672758d049d req-4dff5f63-25cb-4fde-988f-778f71387433 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:16.196643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-1a8a2bc7-c570-409c-aeb7-a672758d049d req-4dff5f63-25cb-4fde-988f-778f71387433 service nova] Creating event network-vif-plugged:d2b7fbe9-4495-4de8-b167-ed4d5ac257d8 for instance 7775f455-5795-417b-9527-5541344dead1 on hv-cinder-85044 Jul 21 05:54:16.201784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-1a8a2bc7-c570-409c-aeb7-a672758d049d req-4dff5f63-25cb-4fde-988f-778f71387433 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Jul 21 05:54:16.202337 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 482/738] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:54:16.207660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:16.208335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:16.214521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:16.214947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:16.215771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:16.216194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:16.230656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:54:16.352105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:16.360107 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:16.361593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:16.362736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2459b83a-54ae-4d2d-85be-3c9e66437407 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.159235 Jul 21 05:54:16.363333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 483/739] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:16 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:17.385434 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:17.386529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:17.396480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:17.396914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:17.397666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:17.398086 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:17.541220 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:17.549764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:17.551366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:17.552516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4e229050-cc62-49ae-ab56-f6953a9246fc tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.173762 Jul 21 05:54:17.553064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 484/740] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:17 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:18.576854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:18.577450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:18.584242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:18.584741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:18.585507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:18.585928 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:18.721033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:18.729348 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:18.731103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:18.732465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ac5a046e-facb-48ec-833e-1fc94e90da75 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1728 microversion: 2.20 time: 0.159570 Jul 21 05:54:18.733135 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 485/741] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:18 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:19.755347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:54:19.756366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:54:19.767525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:19.768151 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:19.769392 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:54:19.770042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:54:19.907049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:19.915933 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:19.917438 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:54:19.918575 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-15637fae-fa7c-4624-97ce-473d92ad1925 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1715 microversion: 2.20 time: 0.169883 Jul 21 05:54:19.919204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 486/742] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:54:19 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1715 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:54:32.057464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 05:54:32.058433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Thu Jul 21 05:54:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 05:55:07.701207 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:07.701876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:07.705811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=33 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:07.706528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=21 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:07.712060 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:07.712532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:07.713683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:07.714233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:07.741844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lazy-loading 'flavor' on Instance uuid 02e229f5-22b2-4084-8cef-30070589917c {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:55:07.824074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-93ae6a0d-21d9-49fe-8813-4e78f618d8a1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "POST /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c/action" status: 202 len: 0 microversion: 2.1 time: 0.127488 Jul 21 05:55:07.824649 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 487/743] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:55:07 2022] POST /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:55:07.834228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:07.834912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:07.841617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:07.842031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:07.842837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:07.843506 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:07.984331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:07.992269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-87634255-b226-4a56-b6c0-141cb33aaf90 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.162848 Jul 21 05:55:07.992837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 488/744] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:07 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:55:09.011806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:09.012611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:09.020200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:09.020652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:09.021414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:09.021849 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:09.159623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:09.167313 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c92127c1-15ba-467b-9f9c-d57487ac292e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.160599 Jul 21 05:55:09.167866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 489/745] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:09 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:10.185497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:10.186221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:10.193147 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:10.193589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:10.194338 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:10.194770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:10.341665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:10.352978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-78fcd9d7-ee2e-49b3-97b2-925ada307ac4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.171238 Jul 21 05:55:10.353798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 490/746] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:10 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:11.376755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:11.377744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:11.388505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:11.389244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:11.390424 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:11.390847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:11.534870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:11.547117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-28cf3043-429f-4980-84d5-3d9e1c056cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.176658 Jul 21 05:55:11.547998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 491/747] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:11 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:12.564736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:12.565444 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:12.572335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:12.572776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:12.573540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:12.573975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:12.710345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:12.721918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b90b2c69-5298-492c-be2c-aa0e61dbfd6d tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.161183 Jul 21 05:55:12.722576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 492/748] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:12 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:13.747356 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:13.748336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:13.755447 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:13.755887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:13.756647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:13.757083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:13.887366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:13.895697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f48506b3-05ea-4ee1-80e7-87b0e29494bb tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.154840 Jul 21 05:55:13.896196 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 493/749] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:13 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:14.919904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:14.920739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:14.927904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:14.928348 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:14.929108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:14.929531 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:15.078311 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:15.086012 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8c442176-a14a-45f9-9fe8-d385123b5831 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.172216 Jul 21 05:55:15.086562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 494/750] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:14 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:15.287233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4e05bef3-0cf2-4e5a-b969-6ec695c5954f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:15.288172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4e05bef3-0cf2-4e5a-b969-6ec695c5954f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:15.294420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e05bef3-0cf2-4e5a-b969-6ec695c5954f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:15.294860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e05bef3-0cf2-4e5a-b969-6ec695c5954f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:15.295652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e05bef3-0cf2-4e5a-b969-6ec695c5954f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:15.296080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e05bef3-0cf2-4e5a-b969-6ec695c5954f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:15.325030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4e05bef3-0cf2-4e5a-b969-6ec695c5954f tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041830 Jul 21 05:55:15.325536 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 495/751] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jul 21 05:55:15 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:55:15.387755 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:15.388531 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:15.397793 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:15.398242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:15.399395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:15.399952 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:15.428319 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:55:15.506792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f5a40409-f212-4344-b8f2-f8a1e8bf1fcf tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 204 len: 0 microversion: 2.20 time: 0.124949 Jul 21 05:55:15.507629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 496/752] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 05:55:15 2022] DELETE /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 05:55:15.515908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:15.516586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:15.522419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:15.522854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:15.523627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:15.524050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:15.655511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:15.665406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:15.666917 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:15.668119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7965d270-a87a-405d-9614-7c7269b2971d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.156277 Jul 21 05:55:15.668678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 497/753] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:55:15 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 05:55:16.108235 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:16.109291 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:16.119707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:16.120482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:16.121678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:16.122394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:16.263092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:16.274170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8139dc1b-dba9-4a1e-929e-873392028ed6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.172165 Jul 21 05:55:16.274927 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 498/754] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:16 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:16.686013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:16.686651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:16.693317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:16.693760 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:16.694510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:16.694936 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:16.828757 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:16.832369 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:16.837879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:16.839439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:16.840615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1df1bfd9-56ed-4f99-ab7f-e9354990bbce tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.158601 Jul 21 05:55:16.841178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 499/755] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:55:16 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:55:17.292669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:17.293277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:17.301793 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:17.302272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:17.303224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:17.303824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:17.532011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:17.539931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ad221212-17dc-4c89-87e9-186d843c6b50 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.251493 Jul 21 05:55:17.540472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 500/756] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:17 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:17.860330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:17.860876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:17.867784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:17.868209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:17.868976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:17.869398 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:18.048790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:18.057607 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:18.059141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:18.060297 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9b245808-4113-4054-bcb5-cb5f0dfd4a29 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1721 microversion: 2.20 time: 0.205256 Jul 21 05:55:18.060912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 501/757] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:55:17 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:55:18.556866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:18.557501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:18.568178 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:18.568908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:18.570173 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:18.570792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:18.812870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:18.825023 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-12e9b048-4997-4d30-a981-e1370291e0e6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.272017 Jul 21 05:55:18.826271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 502/758] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:18 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:18.895814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-1efdc4d0-6ac6-4518-9f7c-48b4b611df4b req-e02e5db4-5577-43f8-b82e-f122b3a769b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7775f455-5795-417b-9527-5541344dead1", "name": "network-vif-deleted", "tag": "d2b7fbe9-4495-4de8-b167-ed4d5ac257d8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:18.903991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1efdc4d0-6ac6-4518-9f7c-48b4b611df4b req-e02e5db4-5577-43f8-b82e-f122b3a769b1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:18.904431 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1efdc4d0-6ac6-4518-9f7c-48b4b611df4b req-e02e5db4-5577-43f8-b82e-f122b3a769b1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:18.917958 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-1efdc4d0-6ac6-4518-9f7c-48b4b611df4b req-e02e5db4-5577-43f8-b82e-f122b3a769b1 service nova] Creating event network-vif-deleted:d2b7fbe9-4495-4de8-b167-ed4d5ac257d8 for instance 7775f455-5795-417b-9527-5541344dead1 on hv-cinder-85044 Jul 21 05:55:18.922967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-1efdc4d0-6ac6-4518-9f7c-48b4b611df4b req-e02e5db4-5577-43f8-b82e-f122b3a769b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095272 Jul 21 05:55:18.923742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 503/759] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:55:19.092493 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:19.093361 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:19.102235 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:19.102693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:19.103542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:19.103992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:19.139321 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:19.139792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:19.140442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lazy-loading 'fault' on Instance uuid 7775f455-5795-417b-9527-5541344dead1 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:55:19.185004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:19.192696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:19.194200 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cbf797171144c139c72c516cea59bb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b88b7408762493e825c86d05b5e62bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:19.195418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6feee697-40c7-43ae-b6dc-631f9d7367eb tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 200 len: 1369 microversion: 2.20 time: 0.115261 Jul 21 05:55:19.196099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 504/760] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:55:19 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 1369 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 05:55:19.844999 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:19.845693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:19.853373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:19.853872 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:19.854807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:19.855331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:20.005150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:20.013031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3159d7a6-144b-4450-a458-fb869a2beed2 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.173345 Jul 21 05:55:20.013603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 505/761] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:19 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:20.218226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:20.219280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:20.229714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:20.230455 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:20.231762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:20.232481 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:20.248120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] HTTP exception thrown: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Request method failure captured: Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 HTTP/1.1 Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeQr7ilklxZ9XqEg2x4ZcdVVlTUWztj5xvGpcm-0b3q5k0T7LITkLgfWEsVMxMhV64gCotdUqdVay0zre1IAbf2Uljg9gEsjsBCY0P_VUF6XmJN1nf404Mlr7aIuojjO-r8whgS3LPTETOZr-n5BYb_nODVbh7XsMBKt83pjp4XLMU Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:55:20.249697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7b88b7408762493e825c86d05b5e62bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}] Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 0cbf797171144c139c72c516cea59bb9 Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:20.251403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '7775f455-5795-417b-9527-5541344dead1'} Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:55:20.252532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:20.254080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:20.255676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Returning 404 to user: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:55:20.255676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b506dd71-f117-4a4a-b2ee-4ea3b32685c4 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 404 len: 111 microversion: 2.20 time: 0.039447 Jul 21 05:55:20.255676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 506/762] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:55:20 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 05:55:20.259603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-96912936-247a-4dd3-bd4c-516b34d9d62d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '.version_select at 0x7f50902f2700>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:20.283071 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-96912936-247a-4dd3-bd4c-516b34d9d62d tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-31471644" status: 204 len: 0 microversion: 2.20 time: 0.026953 Jul 21 05:55:20.283624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 507/763] 10.222.0.44 () {60 vars in 1255 bytes} [Thu Jul 21 05:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-31471644 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 05:55:21.030886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:21.031900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:21.039382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:21.039826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:21.040591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:21.041030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:21.179566 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:21.190072 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e20f458d-56d0-4bca-86b0-2f2beec40785 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.163637 Jul 21 05:55:21.190640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 508/764] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:21 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:22.211377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:22.212368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:22.221543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:22.221988 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:22.222746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:22.223223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:22.365403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:22.373343 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e3db9043-2cf0-4ecc-8762-b36420c88458 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.168478 Jul 21 05:55:22.373983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 509/765] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:22 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:23.390449 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:23.391135 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:23.399462 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:23.399894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:23.400657 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:23.401116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:23.560000 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:23.568179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1674ffb5-aae5-4a7c-baf0-c49cc3e13f13 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.181799 Jul 21 05:55:23.568719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 510/766] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:23 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:55:24.150915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:24.151439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:24.158320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.159002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.159805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.160224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.174059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] HTTP exception thrown: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Request method failure captured: Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 HTTP/1.1 Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeQr7ilklxZ9XqEg2x4ZcdVVlTUWztj5xvGpcm-0b3q5k0T7LITkLgfWEsVMxMhV64gCotdUqdVay0zre1IAbf2Uljg9gEsjsBCY0P_VUF6XmJN1nf404Mlr7aIuojjO-r8whgS3LPTETOZr-n5BYb_nODVbh7XsMBKt83pjp4XLMU Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:55:24.175696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7b88b7408762493e825c86d05b5e62bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}] Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 0cbf797171144c139c72c516cea59bb9 Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.177324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '7775f455-5795-417b-9527-5541344dead1'} Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:55:24.178103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.179344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.180546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Returning 404 to user: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:55:24.180546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-af074036-e2e7-46b4-a52f-1f4beecacd45 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 404 len: 111 microversion: 2.20 time: 0.030236 Jul 21 05:55:24.180546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 511/767] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 05:55:24 2022] DELETE /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 05:55:24.187268 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:24.188141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 7775f455-5795-417b-9527-5541344dead1] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:24.193967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.194414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.195303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.195644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.217530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] HTTP exception thrown: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Request method failure captured: Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 HTTP/1.1 Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeQr7ilklxZ9XqEg2x4ZcdVVlTUWztj5xvGpcm-0b3q5k0T7LITkLgfWEsVMxMhV64gCotdUqdVay0zre1IAbf2Uljg9gEsjsBCY0P_VUF6XmJN1nf404Mlr7aIuojjO-r8whgS3LPTETOZr-n5BYb_nODVbh7XsMBKt83pjp4XLMU Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:55:24.219141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7b88b7408762493e825c86d05b5e62bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}] Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 0cbf797171144c139c72c516cea59bb9 Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.220794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '7775f455-5795-417b-9527-5541344dead1'} Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:55:24.221726 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. Jul 21 05:55:24.223226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:24.224561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Returning 404 to user: Instance 7775f455-5795-417b-9527-5541344dead1 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:55:24.224561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bed86087-2647-4368-aaff-f85ecb9c23ae tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1" status: 404 len: 111 microversion: 2.20 time: 0.037192 Jul 21 05:55:24.224561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 512/768] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:55:24 2022] GET /compute/v2.1/servers/7775f455-5795-417b-9527-5541344dead1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 05:55:24.587251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:24.588627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:24.595242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.595686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.596518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.596922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.728650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:24.736884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-79c1f743-bf40-423d-8c4a-b14c10ab0a3e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1508 microversion: 2.1 time: 0.154700 Jul 21 05:55:24.737450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 513/769] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:24 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:55:24.752966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b9421cf9-b944-4d5f-90fe-fe3e867c7683 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:24.753527 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b9421cf9-b944-4d5f-90fe-fe3e867c7683 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:24.759577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b9421cf9-b944-4d5f-90fe-fe3e867c7683 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.760021 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b9421cf9-b944-4d5f-90fe-fe3e867c7683 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.760780 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b9421cf9-b944-4d5f-90fe-fe3e867c7683 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.761211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b9421cf9-b944-4d5f-90fe-fe3e867c7683 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.838863 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b9421cf9-b944-4d5f-90fe-fe3e867c7683 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "POST /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c/action" status: 202 len: 0 microversion: 2.1 time: 0.089445 Jul 21 05:55:24.839660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 514/770] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:55:24 2022] POST /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:55:24.847237 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:24.847844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:24.854204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.854699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:24.855504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:24.855941 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:25.028175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:25.036443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4d70d15e-202f-4fe0-9ac5-0698a1187cf8 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1516 microversion: 2.1 time: 0.192874 Jul 21 05:55:25.037007 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 515/771] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:24 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:55:25.354294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:25.354785 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:25.361736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:25.362100 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:25.362870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:25.363399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:25.377827 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] HTTP exception thrown: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Request method failure captured: Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 HTTP/1.1 Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeQr7ilklxZ9XqEg2x4ZcdVVlTUWztj5xvGpcm-0b3q5k0T7LITkLgfWEsVMxMhV64gCotdUqdVay0zre1IAbf2Uljg9gEsjsBCY0P_VUF6XmJN1nf404Mlr7aIuojjO-r8whgS3LPTETOZr-n5BYb_nODVbh7XsMBKt83pjp4XLMU Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:55:25.379668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7b88b7408762493e825c86d05b5e62bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}] Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 0cbf797171144c139c72c516cea59bb9 Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.381304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '82c3106a-0a81-4575-b1a7-dc0fc54551e2'} Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:55:25.382098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.383317 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.384521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Returning 404 to user: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:55:25.384521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8967ecbd-14c9-4036-96ca-c3784f2602be tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "DELETE /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 404 len: 111 microversion: 2.20 time: 0.030687 Jul 21 05:55:25.384521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 516/772] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 05:55:25 2022] DELETE /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 21 05:55:25.389903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:25.390247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] [instance: 82c3106a-0a81-4575-b1a7-dc0fc54551e2] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:25.396250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:25.396696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:25.397462 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:25.397897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:25.413065 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] HTTP exception thrown: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Request method failure captured: Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 HTTP/1.1 Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OeQr7ilklxZ9XqEg2x4ZcdVVlTUWztj5xvGpcm-0b3q5k0T7LITkLgfWEsVMxMhV64gCotdUqdVay0zre1IAbf2Uljg9gEsjsBCY0P_VUF6XmJN1nf404Mlr7aIuojjO-r8whgS3LPTETOZr-n5BYb_nODVbh7XsMBKt83pjp4XLMU Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:55:25.414589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7b88b7408762493e825c86d05b5e62bc", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7b88b7408762493e825c86d05b5e62bc"}]}] Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 7b88b7408762493e825c86d05b5e62bc Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1256637500 Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 0cbf797171144c139c72c516cea59bb9 Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1256637500-project Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.416123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '82c3106a-0a81-4575-b1a7-dc0fc54551e2'} Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:55:25.416877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. Jul 21 05:55:25.418103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:55:25.419233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] Returning 404 to user: Instance 82c3106a-0a81-4575-b1a7-dc0fc54551e2 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:55:25.419233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-929c4f68-e1f6-49f2-97ce-f210741e9838 tempest-AttachVolumeShelveTestJSON-1256637500 tempest-AttachVolumeShelveTestJSON-1256637500-project] 10.222.0.44 "GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2" status: 404 len: 111 microversion: 2.20 time: 0.030112 Jul 21 05:55:25.419233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 517/773] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 05:55:25 2022] GET /compute/v2.1/servers/82c3106a-0a81-4575-b1a7-dc0fc54551e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 05:55:26.054442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:26.055103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:26.062136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:26.062584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:26.063473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:26.063904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:26.198155 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:26.206303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-23ea50fa-2cb8-455e-a6e1-17960caf4a97 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1518 microversion: 2.1 time: 0.155916 Jul 21 05:55:26.206908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 518/774] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:26 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:26.909904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-1974b5b8-4383-4e80-ab27-030efbacf656 req-e0d404ab-0b18-45bd-b738-a05534799328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e229f5-22b2-4084-8cef-30070589917c", "name": "network-vif-unplugged", "status": "completed", "tag": "fa8b9f49-d0a2-43fd-ac24-5bc695f065a8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:26.918763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1974b5b8-4383-4e80-ab27-030efbacf656 req-e0d404ab-0b18-45bd-b738-a05534799328 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:26.919267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1974b5b8-4383-4e80-ab27-030efbacf656 req-e0d404ab-0b18-45bd-b738-a05534799328 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:26.932542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.compute.server_external_events [req-1974b5b8-4383-4e80-ab27-030efbacf656 req-e0d404ab-0b18-45bd-b738-a05534799328 service nova] Unable to find a host for instance 02e229f5-22b2-4084-8cef-30070589917c. Dropping event network-vif-unplugged {{(pid=124328) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 05:55:26.933565 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-1974b5b8-4383-4e80-ab27-030efbacf656 req-e0d404ab-0b18-45bd-b738-a05534799328 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028224 Jul 21 05:55:26.934154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 519/775] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 21 05:55:27.224189 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:27.226097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:27.232839 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:27.233208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:27.233975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:27.234427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:27.432846 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:27.436791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:27.441944 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f403daea-616e-40c6-8fa8-56dd628c33b6 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1518 microversion: 2.1 time: 0.221666 Jul 21 05:55:27.442661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 520/776] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:27 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:28.462140 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:28.463506 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:28.471454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:28.472195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:28.472971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:28.473408 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:28.627844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:28.638484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c3a30990-9086-4873-a484-3d5380a12577 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1518 microversion: 2.1 time: 0.182054 Jul 21 05:55:28.649336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 521/777] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:28 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1518 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:55:29.657064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:29.657704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:29.666066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:29.666594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:29.667702 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:29.668314 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:29.823742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:29.832768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cbc7043b-a04e-4c3d-bcb2-49bccf24e863 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1518 microversion: 2.1 time: 0.180181 Jul 21 05:55:29.844982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 522/778] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:29 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:30.019822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-788052242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-179865322", "security_groups": [{"name": "tempest-secgroup-smoke-1102999197"}], "block_device_mapping_v2": [{"uuid": "38c25053-68e5-4b89-b934-35a7b6a0f200", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d24dd506-b76c-4cd5-b8bb-2127b1812879"}]}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:30.233096 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] validate_networks() for [('d24dd506-b76c-4cd5-b8bb-2127b1812879', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:55:30.934247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:55:30.935692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:55:30.936390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:55:30.937015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:55:30.938014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:55:30.951544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:30.952400 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:30.953412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:30.954125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:30.984334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:55:30.994085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Getting quotas for user 17108265cfba44b29c362ac18bbf3e20 and project 0c6f9207778b4e0fbdbbae28c8f7b224. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:55:31.076174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:55:31.079411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='38c25053-68e5-4b89-b934-35a7b6a0f200',volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:55:31.195770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:31.232410 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b392407e-86d2-41c6-95bd-6d475925c5a2 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.217803 Jul 21 05:55:31.233154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 523/779] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:55:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 05:55:31.242015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:31.242904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:31.249807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:31.250516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:31.251310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:31.251901 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:31.287775 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 05:55:31.288428 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 05:55:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 05:55:31.396620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:31.405354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-26bc652a-273a-4aec-a9c6-41c4644d95e1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.170795 Jul 21 05:55:31.406730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 524/780] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:31 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:31.420075 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9d67a691-e4ac-43c1-8da2-e753156a5bfb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:31.421083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9d67a691-e4ac-43c1-8da2-e753156a5bfb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:31.488434 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9d67a691-e4ac-43c1-8da2-e753156a5bfb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:31.506882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9d67a691-e4ac-43c1-8da2-e753156a5bfb tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1093 microversion: 2.1 time: 0.098691 Jul 21 05:55:31.508006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 525/781] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:31 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1093 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:32.423560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:32.424561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:32.436725 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:32.437337 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:32.438233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:32.438765 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:32.611559 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:32.622011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-206e2dae-ec4f-4b14-ac0a-59da42b1aaff tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.202631 Jul 21 05:55:32.623434 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 526/782] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:32 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:32.637210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:32.638924 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:32.646093 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:32.646623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:32.647719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:32.648350 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:32.776074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:32.789790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3d809f75-3212-4c96-9ff5-a067eaddf92f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1191 microversion: 2.1 time: 0.164993 Jul 21 05:55:32.793732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 527/783] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:32 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1191 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:33.641907 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:33.658427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:33.669979 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:33.670794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:33.671649 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:33.672239 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:34.077554 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:34.086445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8b05081f-fb37-43ed-828b-296dc120e6c3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.450691 Jul 21 05:55:34.087555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 528/784] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:33 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:34.099439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:34.100424 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:34.107365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:34.108109 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:34.109468 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:34.110114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:34.397635 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:34.407182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dc879d01-d47c-438d-bcbe-3d844028d1da tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.318287 Jul 21 05:55:34.407768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 529/785] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:34 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:35.067540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a425149e-70ce-4840-b2e2-8bdc0f72c2af tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'create', calling method: .version_select at 0x7f50903b15e0>, body: {"keypair": {"name": "tempest-keypair-1301841332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9Sx/dAVgIW/aX0wzp9gWruJYh4KlJmhjMP7vEIHP59yCe1OeNSY3VhddFa5H5yXz/oVE08a0H/EGHH833eqNAEoPGxHIz8bC8453fI7Vlw/zmoQZJEqHMqJzCs98+N6w=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:35.088717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-a425149e-70ce-4840-b2e2-8bdc0f72c2af tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for project a3f30d9c29794ccfb52188216cd48085. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:55:35.093103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-a425149e-70ce-4840-b2e2-8bdc0f72c2af tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for user e5a03f7524f7436fbbd78a7778702d1b and project a3f30d9c29794ccfb52188216cd48085. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:55:35.122499 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a425149e-70ce-4840-b2e2-8bdc0f72c2af tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221293 Jul 21 05:55:35.131690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 530/786] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 05:55:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:55:35.138561 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:35.139702 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:35.148643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:35.149263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:35.150199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:35.150781 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:35.417159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:35.425481 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0d67bc3f-1695-4fa8-a20a-ba588777647a tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.292622 Jul 21 05:55:35.426058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 531/787] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:35 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:35.437875 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-e15961d5-dfeb-492a-a6c0-bac7c5de76c8 req-51a4e41c-9c52-4d79-a611-dd0cfce8b334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648b822f-2ee2-4afd-8621-8462282585dd", "tag": "39cb4935-b907-4c2e-adff-47d3b1385ab3"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:35.447358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e15961d5-dfeb-492a-a6c0-bac7c5de76c8 req-51a4e41c-9c52-4d79-a611-dd0cfce8b334 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:35.448081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e15961d5-dfeb-492a-a6c0-bac7c5de76c8 req-51a4e41c-9c52-4d79-a611-dd0cfce8b334 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:35.461541 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-e15961d5-dfeb-492a-a6c0-bac7c5de76c8 req-51a4e41c-9c52-4d79-a611-dd0cfce8b334 service nova] Creating event network-changed:39cb4935-b907-4c2e-adff-47d3b1385ab3 for instance 648b822f-2ee2-4afd-8621-8462282585dd on hv-cinder-85044 Jul 21 05:55:35.479478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-e15961d5-dfeb-492a-a6c0-bac7c5de76c8 req-51a4e41c-9c52-4d79-a611-dd0cfce8b334 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047179 Jul 21 05:55:35.481217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 532/788] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:55:35.486882 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:35.487615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:35.495717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:35.496387 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:35.497415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:35.498006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:35.748345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:35.756996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-68bae6bd-bd9d-4482-9ecc-a7398f74083a tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.274303 Jul 21 05:55:35.757572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 533/789] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:35 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:36.453586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:36.454718 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:36.463085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:36.463809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:36.464580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:36.465203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:36.678321 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:36.686814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6415538a-4818-41e3-8c34-27156e34f30e tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.244420 Jul 21 05:55:36.687660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 534/790] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:36 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:36.745257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-394445754", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6393ce2d-637a-46ff-b836-ae9c1c77c3e6"}], "security_groups": [{"name": "tempest-securitygroup--478131343"}], "key_name": "tempest-keypair-1301841332", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:36.906896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] validate_networks() for [('6393ce2d-637a-46ff-b836-ae9c1c77c3e6', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 05:55:37.513750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 05:55:37.514371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 05:55:37.514614 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 05:55:37.515032 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 05:55:37.515443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 05:55:37.525738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:37.526399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:37.527221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:37.527652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:37.544972 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for project a3f30d9c29794ccfb52188216cd48085. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:55:37.549144 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for user e5a03f7524f7436fbbd78a7778702d1b and project a3f30d9c29794ccfb52188216cd48085. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:55:37.560056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 05:55:37.562398 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 05:55:37.613281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a6e7c3ee-0e65-4a87-afe6-e5575b1786c6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.872301 Jul 21 05:55:37.619123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 535/791] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 05:55:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 05:55:37.619123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:37.619386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:37.625897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:37.626375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:37.627216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:37.627624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:37.773833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:37.785717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-518d37ed-bda3-4b5b-b11d-19423f581c50 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.170583 Jul 21 05:55:37.793246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 536/792] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:37 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:37.804385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3111bc08-c3ac-41f3-bb85-03246ee4245a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:37.805225 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3111bc08-c3ac-41f3-bb85-03246ee4245a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:37.892540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3111bc08-c3ac-41f3-bb85-03246ee4245a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:37.900292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3111bc08-c3ac-41f3-bb85-03246ee4245a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1237 microversion: 2.1 time: 0.105613 Jul 21 05:55:37.903182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 537/793] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:37 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1237 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:37.908470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:37.909593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:37.916996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:37.917443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:37.918377 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:37.918836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:38.106990 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:38.120263 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b55106c3-16f7-4370-83fd-5631157095f1 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.215897 Jul 21 05:55:38.132020 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 538/794] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:37 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:38.804040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:38.805663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:38.811891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:38.812812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:38.813746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:38.814600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:39.045484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:39.053084 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3d6f6e70-7fc6-422b-8eb8-a83ea39e908c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.254267 Jul 21 05:55:39.053641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 539/795] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:38 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:39.058110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:39.058994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:39.065274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:39.065814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:39.066662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:39.067229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:39.146673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:39.154564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3e795144-6839-486f-8d9e-75f51447b5e5 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1295 microversion: 2.1 time: 0.099941 Jul 21 05:55:39.155504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 540/796] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:39 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:39.160156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:39.160724 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:39.166810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:39.167275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:39.168038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:39.168452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:39.373253 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:39.381381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-45a3878a-1443-4007-81b7-71594c8cacb5 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.225079 Jul 21 05:55:39.381915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 541/797] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:39 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:40.070199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:40.070894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:40.077894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:40.078315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:40.079169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:40.079604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:40.098656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:40.301791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:40.310639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-16d63112-8f23-453e-8c43-654b6663de86 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.244338 Jul 21 05:55:40.311711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 542/798] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:40 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:40.317001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:40.318464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:40.325815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:40.326555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:40.327537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:40.328179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:40.530875 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:40.539403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-073e2788-b576-4746-b1de-cb409b9b48e2 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.226534 Jul 21 05:55:40.540043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 543/799] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:40 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:40.545376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:40.545989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:40.552686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:40.553127 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:40.553890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:40.554311 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:40.813626 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:40.824623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a74db359-cfb8-40ca-bea5-330a178100a3 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.283536 Jul 21 05:55:40.825216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 544/800] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:40 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:40.829715 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-4aa2af28-2994-4dfb-ad18-0f695b73f0ad req-c3faebb6-55ff-406e-9565-9e425b20f7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46154a5c-faff-482b-a77b-afd4abb0cfbc", "tag": "873310e1-56af-4c83-a4d9-81875a452116"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:40.838107 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-4aa2af28-2994-4dfb-ad18-0f695b73f0ad req-c3faebb6-55ff-406e-9565-9e425b20f7d1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:40.838643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-4aa2af28-2994-4dfb-ad18-0f695b73f0ad req-c3faebb6-55ff-406e-9565-9e425b20f7d1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:40.852810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-4aa2af28-2994-4dfb-ad18-0f695b73f0ad req-c3faebb6-55ff-406e-9565-9e425b20f7d1 service nova] Creating event network-changed:873310e1-56af-4c83-a4d9-81875a452116 for instance 46154a5c-faff-482b-a77b-afd4abb0cfbc on hv-cinder-85044 Jul 21 05:55:40.857697 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-4aa2af28-2994-4dfb-ad18-0f695b73f0ad req-c3faebb6-55ff-406e-9565-9e425b20f7d1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031344 Jul 21 05:55:40.858473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 545/801] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:55:41.082741 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-3d3e366c-1bfd-41a8-a583-e8a9ede9edba req-39ead8ba-0086-49a4-ad3c-a987c4d59275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e229f5-22b2-4084-8cef-30070589917c", "name": "network-vif-plugged", "status": "completed", "tag": "fa8b9f49-d0a2-43fd-ac24-5bc695f065a8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:41.094099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-3d3e366c-1bfd-41a8-a583-e8a9ede9edba req-39ead8ba-0086-49a4-ad3c-a987c4d59275 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:41.094099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-3d3e366c-1bfd-41a8-a583-e8a9ede9edba req-39ead8ba-0086-49a4-ad3c-a987c4d59275 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:41.106300 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-3d3e366c-1bfd-41a8-a583-e8a9ede9edba req-39ead8ba-0086-49a4-ad3c-a987c4d59275 service nova] Creating event network-vif-plugged:fa8b9f49-d0a2-43fd-ac24-5bc695f065a8 for instance 02e229f5-22b2-4084-8cef-30070589917c on hv-cinder-85044 Jul 21 05:55:41.111910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-3d3e366c-1bfd-41a8-a583-e8a9ede9edba req-39ead8ba-0086-49a4-ad3c-a987c4d59275 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098638 Jul 21 05:55:41.112440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 546/802] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:55:41.329597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:41.330288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:41.337877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:41.338611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:41.339403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:41.339833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:41.504900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:41.512890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2677e3d2-d80d-4820-9681-360b82aafbc8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.188718 Jul 21 05:55:41.513463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 547/803] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:41 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:41.561204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:41.561835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:41.568196 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:41.568645 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:41.569415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:41.569858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:41.701302 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:41.715000 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ad088dd6-326a-4b3a-8b86-26e1fa553b1f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.157120 Jul 21 05:55:41.715891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 548/804] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:41 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:41.845195 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:41.846206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:41.856571 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:41.857307 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:41.858560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:41.859319 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:41.994281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:42.002401 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d55ae4bb-1a7a-43a0-b546-d9e16de766fa tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.163651 Jul 21 05:55:42.002964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 549/805] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:41 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:42.530427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:42.531512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:42.538315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:42.538758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:42.539556 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:42.539987 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:42.680779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:42.688866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-69fb9eb6-01c3-4468-9293-5cecf780bda7 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.162643 Jul 21 05:55:42.689430 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 550/806] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:42 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:42.733459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:42.734056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:42.740212 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:42.740678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:42.741469 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:42.741899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:42.871829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:42.879785 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-43cd805a-0918-4195-9570-fefdd11025ee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.150038 Jul 21 05:55:42.880347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 551/807] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:42 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:43.028443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:43.029441 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:43.037807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:43.038268 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:43.039045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:43.039483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:43.174541 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:43.182669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ceed0e67-679d-4fcc-8c79-f8e683933997 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.161021 Jul 21 05:55:43.183247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 552/808] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:43 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:43.705886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:43.706548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:43.713097 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:43.713548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:43.714293 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:43.714728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:43.850205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:43.858356 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b3712774-a219-410b-b01a-1cdc1f710ac6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.156460 Jul 21 05:55:43.858886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 553/809] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:43 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:43.896487 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:43.897124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:43.903926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:43.904282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:43.905031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:43.905459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:44.042722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:44.053912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-95768b43-c078-4fa7-a733-ab438117a863 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.161352 Jul 21 05:55:44.054511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 554/810] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:43 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:44.203816 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:44.204806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:44.212061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:44.212547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:44.213382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:44.213854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:44.356997 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:44.364960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9ebc8613-33c8-4dea-9914-206f7525dec4 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.167418 Jul 21 05:55:44.365731 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 555/811] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:44 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:44.879529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:44.880575 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:44.893729 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:44.894529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:44.896251 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:44.896932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:45.065282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:45.073711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f5c402f9-3b26-499c-9a24-c7be31264865 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.200836 Jul 21 05:55:45.074545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 556/812] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:44 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:45.079617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:45.079617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:45.083008 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:45.086747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:45.087221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:45.087982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:45.088407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:45.218553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:45.226525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d78d6972-5898-4faa-b72d-8d2000f01fcb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.151063 Jul 21 05:55:45.227154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 557/813] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:45 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:45.382733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:45.383397 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:45.389574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:45.390012 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:45.390760 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:45.391193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:45.612916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:45.620979 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-de8b71cd-d7ac-4095-9c97-ca2d17d0a053 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1574 microversion: 2.1 time: 0.242129 Jul 21 05:55:45.621530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 558/814] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:45 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1574 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:55:45.854213 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 05:55:45.855104 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 05:55:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 05:55:46.090029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:46.090625 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:46.097596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:46.098042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:46.098811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:46.099316 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:46.236804 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:46.245078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1e4ae7db-f9a1-4153-b717-ed9f9cefacd9 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.159076 Jul 21 05:55:46.245924 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 559/815] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:46 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:46.250260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:46.250723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:46.256963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:46.257409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:46.258163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:46.258591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:46.276794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=100 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:46.390832 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:46.399958 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5a957114-07e9-4875-ae64-f67b912f506f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.153306 Jul 21 05:55:46.400751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 560/816] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:46 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:46.638136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:46.638658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:46.645563 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:46.646013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:46.646764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:46.647258 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:46.781894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:46.790057 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-43772e12-7c8d-455f-8234-9b7c81502d01 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1561 microversion: 2.1 time: 0.156367 Jul 21 05:55:46.790630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 561/817] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:46 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:47.266206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:47.267295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:47.276954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:47.277426 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:47.278239 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:47.278698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:47.413854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:47.425709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b1e84b5f-459d-4cdb-a7a9-74cf587d8896 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.165740 Jul 21 05:55:47.426630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 562/818] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:47 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:47.433967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:47.434967 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:47.443132 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:47.443580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:47.444344 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:47.444777 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:47.534646 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:47.581012 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:47.588480 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6b1a2d34-b156-4603-bdb5-e35c8e4eef04 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.160594 Jul 21 05:55:47.589053 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 563/819] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:47 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:48.032609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=20 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:55:48.036625 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-188ada14-42a6-4e9d-9ed7-c52460d0e2bb req-b0458c4c-00e0-4fcc-bd5b-6c701b1467a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648b822f-2ee2-4afd-8621-8462282585dd", "name": "network-vif-plugged", "status": "completed", "tag": "39cb4935-b907-4c2e-adff-47d3b1385ab3"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:48.045383 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-188ada14-42a6-4e9d-9ed7-c52460d0e2bb req-b0458c4c-00e0-4fcc-bd5b-6c701b1467a5 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:48.045818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-188ada14-42a6-4e9d-9ed7-c52460d0e2bb req-b0458c4c-00e0-4fcc-bd5b-6c701b1467a5 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:48.057278 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-188ada14-42a6-4e9d-9ed7-c52460d0e2bb req-b0458c4c-00e0-4fcc-bd5b-6c701b1467a5 service nova] Creating event network-vif-plugged:39cb4935-b907-4c2e-adff-47d3b1385ab3 for instance 648b822f-2ee2-4afd-8621-8462282585dd on hv-cinder-85044 Jul 21 05:55:48.062406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-188ada14-42a6-4e9d-9ed7-c52460d0e2bb req-b0458c4c-00e0-4fcc-bd5b-6c701b1467a5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030728 Jul 21 05:55:48.063036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 564/820] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:55:48.449570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:48.450365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:48.459941 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:48.460526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:48.462305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:48.462305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:48.611181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:48.619610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a4ad31b5-02b0-4be7-9afc-db1b3de3e4fa tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.174911 Jul 21 05:55:48.620184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 565/821] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:48 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:48.624583 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:48.625186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:48.631300 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:48.631749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:48.632592 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:48.632963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:48.771871 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:48.779528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8ffa52f1-4b22-4c10-b7ba-62da7976784e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.158350 Jul 21 05:55:48.780122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 566/822] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:48 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:49.640648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:49.641587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:49.651378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:49.652015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:49.653094 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:49.653705 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:49.787291 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:49.795399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6ea3c179-2c76-4018-b475-bcbe15cfa0f6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1265 microversion: 2.1 time: 0.161238 Jul 21 05:55:49.795907 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 567/823] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:49 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:49.800488 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:49.801087 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:49.807208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:49.807653 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:49.808419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:49.808850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:49.946657 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:49.954574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8dee5213-2bf9-4989-b69a-db605921ac13 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.157625 Jul 21 05:55:49.955184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 568/824] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:49 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:50.085815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-2de9e298-3e0c-4f2e-a077-2280aaa27aa8 req-ba8cb19a-10c3-4231-93d3-a332468968e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46154a5c-faff-482b-a77b-afd4abb0cfbc", "name": "network-vif-plugged", "status": "completed", "tag": "873310e1-56af-4c83-a4d9-81875a452116"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:50.094537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2de9e298-3e0c-4f2e-a077-2280aaa27aa8 req-ba8cb19a-10c3-4231-93d3-a332468968e8 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:50.094980 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2de9e298-3e0c-4f2e-a077-2280aaa27aa8 req-ba8cb19a-10c3-4231-93d3-a332468968e8 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:50.106240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-2de9e298-3e0c-4f2e-a077-2280aaa27aa8 req-ba8cb19a-10c3-4231-93d3-a332468968e8 service nova] Creating event network-vif-plugged:873310e1-56af-4c83-a4d9-81875a452116 for instance 46154a5c-faff-482b-a77b-afd4abb0cfbc on hv-cinder-85044 Jul 21 05:55:50.111351 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-2de9e298-3e0c-4f2e-a077-2280aaa27aa8 req-ba8cb19a-10c3-4231-93d3-a332468968e8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029218 Jul 21 05:55:50.112143 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 569/825] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:55:50.818288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:50.819465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:50.830093 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:50.830819 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:50.832210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:50.832637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:50.986290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:50.995065 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4424485a-fb52-41af-8895-cc42b48a7851 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1453 microversion: 2.1 time: 0.184750 Jul 21 05:55:50.995644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 570/826] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:50 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:51.000098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:51.000722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:51.006808 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:51.007292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:51.008047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:51.008478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:51.145553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:51.157490 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dbb8d1ee-9782-452c-b82d-cdaaa0ef1adf tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.160625 Jul 21 05:55:51.158262 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 571/827] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:50 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:51.162817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:51.163457 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:51.169520 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:51.169973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:51.170742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:51.171284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:51.309599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:51.321161 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7d8ad3f5-8459-432f-b69b-bc69b781fbb5 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1453 microversion: 2.1 time: 0.161953 Jul 21 05:55:51.321742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 572/828] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:51 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:52.175054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:52.175850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:52.182718 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:52.183193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:52.183956 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:52.184381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:52.386640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:52.394664 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3ba5a72b-11ad-4799-86d6-645ec9700fb6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1362 microversion: 2.1 time: 0.223507 Jul 21 05:55:52.395550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 573/829] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:52 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:53.152930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-5361b02f-d2d0-4a3a-8740-ebf722c86bde req-aa7e9a96-6d8d-4721-b574-0884be841821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648b822f-2ee2-4afd-8621-8462282585dd", "tag": "39cb4935-b907-4c2e-adff-47d3b1385ab3"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:53.164159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-5361b02f-d2d0-4a3a-8740-ebf722c86bde req-aa7e9a96-6d8d-4721-b574-0884be841821 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:53.166126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-5361b02f-d2d0-4a3a-8740-ebf722c86bde req-aa7e9a96-6d8d-4721-b574-0884be841821 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:53.181705 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-5361b02f-d2d0-4a3a-8740-ebf722c86bde req-aa7e9a96-6d8d-4721-b574-0884be841821 service nova] Creating event network-changed:39cb4935-b907-4c2e-adff-47d3b1385ab3 for instance 648b822f-2ee2-4afd-8621-8462282585dd on hv-cinder-85044 Jul 21 05:55:53.187174 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-5361b02f-d2d0-4a3a-8740-ebf722c86bde req-aa7e9a96-6d8d-4721-b574-0884be841821 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038254 Jul 21 05:55:53.188199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 574/830] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:55:53.414106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:53.414802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:53.421217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:53.421661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:53.422414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:53.422845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:53.555903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:55:53.563806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e12931c1-ed56-4a9f-8714-6a81aea40439 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1547 microversion: 2.1 time: 0.154583 Jul 21 05:55:53.564364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 575/831] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:55:53 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:55:53.580888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9ab25f95-5877-4f14-8004-eda781900aae tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:55:53.581544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9ab25f95-5877-4f14-8004-eda781900aae tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:55:53.588582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ab25f95-5877-4f14-8004-eda781900aae tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:53.589009 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ab25f95-5877-4f14-8004-eda781900aae tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:53.589790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ab25f95-5877-4f14-8004-eda781900aae tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:53.590218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9ab25f95-5877-4f14-8004-eda781900aae tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:53.710264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9ab25f95-5877-4f14-8004-eda781900aae tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133232 Jul 21 05:55:53.711291 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 576/832] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 05:55:53 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:55:54.691615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-cb856a2d-ecb0-4558-bd72-fea12e07c210 req-c160d202-5f99-46d8-b71e-f51f7c26f794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46154a5c-faff-482b-a77b-afd4abb0cfbc", "tag": "873310e1-56af-4c83-a4d9-81875a452116"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:55:54.699676 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-cb856a2d-ecb0-4558-bd72-fea12e07c210 req-c160d202-5f99-46d8-b71e-f51f7c26f794 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:55:54.700106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-cb856a2d-ecb0-4558-bd72-fea12e07c210 req-c160d202-5f99-46d8-b71e-f51f7c26f794 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:55:54.714031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-cb856a2d-ecb0-4558-bd72-fea12e07c210 req-c160d202-5f99-46d8-b71e-f51f7c26f794 service nova] Creating event network-changed:873310e1-56af-4c83-a4d9-81875a452116 for instance 46154a5c-faff-482b-a77b-afd4abb0cfbc on hv-cinder-85044 Jul 21 05:55:54.719049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-cb856a2d-ecb0-4558-bd72-fea12e07c210 req-c160d202-5f99-46d8-b71e-f51f7c26f794 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031702 Jul 21 05:55:54.719758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 577/833] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:57:09.802192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=40 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:09.803392 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=86 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:09.809924 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ba80fcf8-3d72-4c56-86ca-7a57d719ad40 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:09.810505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ba80fcf8-3d72-4c56-86ca-7a57d719ad40 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:09.817660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba80fcf8-3d72-4c56-86ca-7a57d719ad40 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:09.818106 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba80fcf8-3d72-4c56-86ca-7a57d719ad40 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:09.818862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba80fcf8-3d72-4c56-86ca-7a57d719ad40 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:09.819334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba80fcf8-3d72-4c56-86ca-7a57d719ad40 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:09.842542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ba80fcf8-3d72-4c56-86ca-7a57d719ad40 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/ips" status: 200 len: 145 microversion: 2.1 time: 0.044420 Jul 21 05:57:09.843133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 578/834] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 05:57:09 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:57:12.524435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-706c1f58-14d9-4b3b-a34f-d1473d5ab2f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb329e93-3d60-42ea-927b-77cb23f1c8f8"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:57:12.525506 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-706c1f58-14d9-4b3b-a34f-d1473d5ab2f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:12.534698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-706c1f58-14d9-4b3b-a34f-d1473d5ab2f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:12.535152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-706c1f58-14d9-4b3b-a34f-d1473d5ab2f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:12.535938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-706c1f58-14d9-4b3b-a34f-d1473d5ab2f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:12.536371 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-706c1f58-14d9-4b3b-a34f-d1473d5ab2f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:12.824484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-706c1f58-14d9-4b3b-a34f-d1473d5ab2f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303441 Jul 21 05:57:12.825250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 579/835] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 05:57:12 2022] POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:57:20.404117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d9f37ed0-01a9-437a-b485-a23f26e817f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:57:20.413429 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9f37ed0-01a9-437a-b485-a23f26e817f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:20.413877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9f37ed0-01a9-437a-b485-a23f26e817f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:20.473044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d9f37ed0-01a9-437a-b485-a23f26e817f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Going to try to stop instance {{(pid=124328) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 05:57:20.523082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d9f37ed0-01a9-437a-b485-a23f26e817f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action" status: 202 len: 0 microversion: 2.1 time: 0.123979 Jul 21 05:57:20.523665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 580/836] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:57:20 2022] POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:57:20.532679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:20.533367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:20.539968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:20.540413 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:20.541208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:20.541682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:20.680556 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:20.688944 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-40e2fd1a-6077-4cad-b47e-75f63c2842f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.160957 Jul 21 05:57:20.689513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 581/837] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:20 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:21.707214 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:21.707900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:21.715844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:21.716287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:21.717036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:21.717463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:21.848465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:21.860894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c51e2c87-6150-450b-ac36-e1909ede982c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.158122 Jul 21 05:57:21.861478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 582/838] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:21 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:22.881782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:22.882713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:22.891545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:22.891993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:22.892752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:22.893183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:23.024228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:23.032678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e7db8150-5165-49dc-8a10-877a07d39993 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.156435 Jul 21 05:57:23.033247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 583/839] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:22 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:24.050558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:24.051167 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:24.058403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:24.058851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:24.059764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:24.060071 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:24.201771 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:24.210443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b36628c3-6dc3-46d2-adb7-1fd1d0074019 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.163887 Jul 21 05:57:24.211040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 584/840] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:24 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:25.232006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:25.232914 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:25.239966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:25.240410 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:25.241171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:25.241604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:25.372688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:25.381165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-da7283e3-f513-4b5b-b34d-0b8e734ee716 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.155731 Jul 21 05:57:25.381710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 585/841] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:25 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:26.402567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:26.403665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:26.411804 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:26.412376 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:26.413240 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:26.413714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:26.559598 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:26.570144 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9d9450d7-b6d7-46c6-9942-9e44e45e90db tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.174156 Jul 21 05:57:26.570735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 586/842] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:26 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:27.590883 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:27.591589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:27.598837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:27.599343 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:27.600122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:27.600566 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:27.730891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:27.739856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c3de2e8f-fa6b-458c-9c2d-97925b868185 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.153838 Jul 21 05:57:27.740422 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 587/843] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:27 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:28.761210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:28.762239 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:28.770299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:28.770744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:28.771546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:28.771998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:28.917533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:28.926037 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-120a58e6-0ce8-4ac1-b999-31ec1aea2076 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.171670 Jul 21 05:57:28.926585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 588/844] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:28 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:29.947855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:29.948910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:29.960016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:29.960746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:29.961986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:29.962691 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:30.104211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:30.113052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c958d898-63fc-4b1b-b94a-0c16d0b87f3d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1722 microversion: 2.1 time: 0.172153 Jul 21 05:57:30.113599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 589/845] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:29 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:31.134095 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:31.135180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:31.144024 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:31.144469 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:31.145230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:31.145665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:31.288897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:31.297114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d5c6dcb8-4a51-4871-974a-76a23633327b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1699 microversion: 2.1 time: 0.169690 Jul 21 05:57:31.297688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 590/846] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:31 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1699 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:31.313372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-da1f3331-54ba-41da-b83a-8deab3257d32 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:57:31.319597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-da1f3331-54ba-41da-b83a-8deab3257d32 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:31.320048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-da1f3331-54ba-41da-b83a-8deab3257d32 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:31.342054 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-da1f3331-54ba-41da-b83a-8deab3257d32 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Going to try to start instance {{(pid=124328) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 05:57:31.365674 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:31.388863 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-da1f3331-54ba-41da-b83a-8deab3257d32 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action" status: 202 len: 0 microversion: 2.1 time: 0.078884 Jul 21 05:57:31.389423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 591/847] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:57:31 2022] POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:57:31.398620 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:31.399338 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:31.406110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:31.406951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:31.407848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:31.408264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:31.581706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:31.589751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8ad37ed7-ce2c-45a1-8620-a2cd7084bce8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1708 microversion: 2.1 time: 0.195334 Jul 21 05:57:31.590299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 592/848] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:31 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1708 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:32.608030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:32.608892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:32.615524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:32.615973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:32.616733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:32.617165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:32.750848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:32.759523 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b1dbfbf3-3e48-44df-87b9-68948c2db772 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1708 microversion: 2.1 time: 0.155665 Jul 21 05:57:32.760099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 593/849] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:32 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:33.777638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:33.778966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:33.786572 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:33.787298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:33.788328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:33.788870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:33.921648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:33.929734 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8d64e8a3-a670-41a2-b96b-07ca03d2548c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1712 microversion: 2.1 time: 0.156070 Jul 21 05:57:33.930332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 594/850] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:33 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:33.934682 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:33.935202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:33.941216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:33.941658 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:33.942442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:33.942865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:33.969818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:57:34.055752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bcd6df95-ea9d-45ed-b2d1-24634ca95f37 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "DELETE /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 204 len: 0 microversion: 2.1 time: 0.124032 Jul 21 05:57:34.056294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 595/851] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:57:33 2022] DELETE /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:57:34.117363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-7b660333-5661-43de-9ad5-1ac5e1aa1b2d req-e84577dd-bf81-4a15-8d0d-b986a948d570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02e229f5-22b2-4084-8cef-30070589917c", "tag": "fa8b9f49-d0a2-43fd-ac24-5bc695f065a8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:57:34.125612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-7b660333-5661-43de-9ad5-1ac5e1aa1b2d req-e84577dd-bf81-4a15-8d0d-b986a948d570 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:34.126050 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-7b660333-5661-43de-9ad5-1ac5e1aa1b2d req-e84577dd-bf81-4a15-8d0d-b986a948d570 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:34.137099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-7b660333-5661-43de-9ad5-1ac5e1aa1b2d req-e84577dd-bf81-4a15-8d0d-b986a948d570 service nova] Creating event network-changed:fa8b9f49-d0a2-43fd-ac24-5bc695f065a8 for instance 02e229f5-22b2-4084-8cef-30070589917c on hv-cinder-85044 Jul 21 05:57:34.142423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-7b660333-5661-43de-9ad5-1ac5e1aa1b2d req-e84577dd-bf81-4a15-8d0d-b986a948d570 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084855 Jul 21 05:57:34.143035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 596/852] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:57:34.147858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:34.148575 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:34.154931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:34.155477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:34.157140 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:34.157881 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:34.291577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:34.299343 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bf21ada5-da50-42ee-baba-ac11c957c893 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.155154 Jul 21 05:57:34.299893 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 597/853] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:34 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:35.320199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:35.320906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:35.331002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:35.331626 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:35.332744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:35.333114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:35.478777 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:35.487151 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7d88c7b6-3a53-4f94-b883-cf1aafd91b53 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1567 microversion: 2.1 time: 0.173222 Jul 21 05:57:35.487719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 598/854] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:35 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:36.432593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-d29cf3f7-18bd-4741-a421-f05fea210a60 req-3675dee5-6c8b-4e5a-b81b-9644bbefc223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02e229f5-22b2-4084-8cef-30070589917c", "name": "network-vif-deleted", "tag": "fa8b9f49-d0a2-43fd-ac24-5bc695f065a8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:57:36.443221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-d29cf3f7-18bd-4741-a421-f05fea210a60 req-3675dee5-6c8b-4e5a-b81b-9644bbefc223 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:36.443659 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-d29cf3f7-18bd-4741-a421-f05fea210a60 req-3675dee5-6c8b-4e5a-b81b-9644bbefc223 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:36.456247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-d29cf3f7-18bd-4741-a421-f05fea210a60 req-3675dee5-6c8b-4e5a-b81b-9644bbefc223 service nova] Creating event network-vif-deleted:fa8b9f49-d0a2-43fd-ac24-5bc695f065a8 for instance 02e229f5-22b2-4084-8cef-30070589917c on hv-cinder-85044 Jul 21 05:57:36.461331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-d29cf3f7-18bd-4741-a421-f05fea210a60 req-3675dee5-6c8b-4e5a-b81b-9644bbefc223 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Jul 21 05:57:36.462436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 599/855] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:57:36.505160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:36.505845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:36.512454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:36.512892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:36.513644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:36.514073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:36.579124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b894a36d43224aba9fc4b14b151e75b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c683289fa724e71bb7a9f69154c84a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:36.586730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-13041b07-7636-4811-a08b-7ecbf7635008 tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 200 len: 1218 microversion: 2.1 time: 0.085826 Jul 21 05:57:36.587327 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 600/856] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:36 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:37.608570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:37.609569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] [instance: 02e229f5-22b2-4084-8cef-30070589917c] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:37.620568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:37.621315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:37.622617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:37.623366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:37.638158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] HTTP exception thrown: Instance 02e229f5-22b2-4084-8cef-30070589917c could not be found. Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Request method failure captured: Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c HTTP/1.1 Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2Ol1xQNhyRD2NIsTcqultKzZzFClxw2UciY4EzryErqrE-cNKoHeN3Dl-ZPYtzLlw0rt-7osWQ3y6bmi5WoFbwrTyrYYDPDFxtuB1pgLpuEuLF9hJjqZgVxo1S-oP0ZWY9iqcW9nvagA-RAIPQYfZyA9KN_FDTcNaUug-cVmqMVOwzE Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 6c683289fa724e71bb7a9f69154c84a1 Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestShelveInstance-510814107 Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:57:37.639861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6c683289fa724e71bb7a9f69154c84a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6c683289fa724e71bb7a9f69154c84a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6c683289fa724e71bb7a9f69154c84a1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6c683289fa724e71bb7a9f69154c84a1"}]}] Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestShelveInstance-510814107 Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 6c683289fa724e71bb7a9f69154c84a1 Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestShelveInstance-510814107 Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestShelveInstance-510814107-project Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: b894a36d43224aba9fc4b14b151e75b2 Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestShelveInstance-510814107-project Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 02e229f5-22b2-4084-8cef-30070589917c could not be found. Jul 21 05:57:37.641522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '02e229f5-22b2-4084-8cef-30070589917c'} Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02e229f5-22b2-4084-8cef-30070589917c could not be found. Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:57:37.642362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02e229f5-22b2-4084-8cef-30070589917c could not be found. Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02e229f5-22b2-4084-8cef-30070589917c could not be found. Jul 21 05:57:37.643751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:57:37.644946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Returning 404 to user: Instance 02e229f5-22b2-4084-8cef-30070589917c could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:57:37.644946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ee687417-0eb2-4522-80b4-695268d0e0fe tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c" status: 404 len: 111 microversion: 2.1 time: 0.039873 Jul 21 05:57:37.644946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 601/857] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:37 2022] GET /compute/v2.1/servers/02e229f5-22b2-4084-8cef-30070589917c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:57:37.809926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5976ca05-9e60-4096-980b-5ed47737ecba tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] Calling method '.version_select at 0x7f5090582ca0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:37.829786 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5976ca05-9e60-4096-980b-5ed47737ecba tempest-TestShelveInstance-510814107 tempest-TestShelveInstance-510814107-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-541431774" status: 202 len: 0 microversion: 2.1 time: 0.023656 Jul 21 05:57:37.830373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 602/858] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 05:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-541431774 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 05:57:56.981254 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:56.981946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:56.984754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:56.985473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:57:56.992594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:56.993153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:56.994011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:56.994496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:57.023380 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:57:57.117221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-44d15793-143f-462f-9e6c-d4a1023af527 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "DELETE /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 204 len: 0 microversion: 2.1 time: 0.139670 Jul 21 05:57:57.117800 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 603/859] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:57:56 2022] DELETE /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 05:57:57.122776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-0c6bd3b6-c66b-488e-8623-e25b4886f448 req-b92334df-c17a-4330-878b-bd392e67530c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "648b822f-2ee2-4afd-8621-8462282585dd", "tag": "39cb4935-b907-4c2e-adff-47d3b1385ab3"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:57:57.133440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0c6bd3b6-c66b-488e-8623-e25b4886f448 req-b92334df-c17a-4330-878b-bd392e67530c service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:57.134171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0c6bd3b6-c66b-488e-8623-e25b4886f448 req-b92334df-c17a-4330-878b-bd392e67530c service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:57.148767 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-0c6bd3b6-c66b-488e-8623-e25b4886f448 req-b92334df-c17a-4330-878b-bd392e67530c service nova] Creating event network-changed:39cb4935-b907-4c2e-adff-47d3b1385ab3 for instance 648b822f-2ee2-4afd-8621-8462282585dd on hv-cinder-85044 Jul 21 05:57:57.154019 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-0c6bd3b6-c66b-488e-8623-e25b4886f448 req-b92334df-c17a-4330-878b-bd392e67530c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034975 Jul 21 05:57:57.154648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 604/860] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:57:57.160015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:57.160733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:57.168180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:57.168570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:57.169334 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:57.169767 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:57.303153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:57.311189 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8818a959-bfd3-4ad3-bddc-d64917a8ec8e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1577 microversion: 2.1 time: 0.155359 Jul 21 05:57:57.311754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 605/861] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:57 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:58.333126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:58.334165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:58.344856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:58.345593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:58.346878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:58.347613 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:58.504075 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:58.512039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-462d2f55-f7f7-4a9b-9c50-6cb279f9498f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1577 microversion: 2.1 time: 0.185586 Jul 21 05:57:58.512602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 606/862] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:58 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:59.530822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:57:59.531442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:57:59.538629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:59.539111 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:59.539870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:59.540304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:57:59.774014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:57:59.782584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5d3cbda9-e897-4384-bf9e-a7a86ccb342c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1577 microversion: 2.1 time: 0.255715 Jul 21 05:57:59.783189 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 607/863] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:57:59 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1577 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:57:59.982734 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-23bfd184-a60b-423d-8e8c-e9e4cb35854f req-77ebd482-0258-4a4a-9be0-1c177c83f17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "648b822f-2ee2-4afd-8621-8462282585dd", "name": "network-vif-deleted", "tag": "39cb4935-b907-4c2e-adff-47d3b1385ab3"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:57:59.990644 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-23bfd184-a60b-423d-8e8c-e9e4cb35854f req-77ebd482-0258-4a4a-9be0-1c177c83f17e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:57:59.991133 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-23bfd184-a60b-423d-8e8c-e9e4cb35854f req-77ebd482-0258-4a4a-9be0-1c177c83f17e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:00.004538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-23bfd184-a60b-423d-8e8c-e9e4cb35854f req-77ebd482-0258-4a4a-9be0-1c177c83f17e service nova] Creating event network-vif-deleted:39cb4935-b907-4c2e-adff-47d3b1385ab3 for instance 648b822f-2ee2-4afd-8621-8462282585dd on hv-cinder-85044 Jul 21 05:58:00.009227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-23bfd184-a60b-423d-8e8c-e9e4cb35854f req-77ebd482-0258-4a4a-9be0-1c177c83f17e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030134 Jul 21 05:58:00.009791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 608/864] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 05:58:00.801382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:00.802035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:00.808586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:00.809024 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:00.809774 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:00.810193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:00.843979 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:00.844430 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:00.844869 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lazy-loading 'fault' on Instance uuid 648b822f-2ee2-4afd-8621-8462282585dd {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:58:00.896530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:00.903609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0c43a8e6-9b80-4828-9b40-ef00e6752d92 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 200 len: 1183 microversion: 2.1 time: 0.107766 Jul 21 05:58:00.904160 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 609/865] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:00 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 1183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:01.925585 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:01.926505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 648b822f-2ee2-4afd-8621-8462282585dd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:01.935305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:01.935926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:01.936925 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:01.937491 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:01.951866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] HTTP exception thrown: Instance 648b822f-2ee2-4afd-8621-8462282585dd could not be found. Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Request method failure captured: Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd HTTP/1.1 Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OkBAyzXMXVOyXlNqf3WjnGrna9lyHWaG73PVmGhx44gAxUfXk7H1ejGqZ7L0amJhbdap4Xbpz1AT5GOn4O2qUEHfJdv6Kiwov7hLWaH-llQ8VJAzE3YuIyQXIXnjg-5--iKV38E_IAk72ZLHEWSeDuMUeiTwAc4Xo1MPUUl7-1wRC0 Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:58:01.953484 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c6f9207778b4e0fbdbbae28c8f7b224", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}] Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 17108265cfba44b29c362ac18bbf3e20 Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 648b822f-2ee2-4afd-8621-8462282585dd could not be found. Jul 21 05:58:01.955175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '648b822f-2ee2-4afd-8621-8462282585dd'} Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 648b822f-2ee2-4afd-8621-8462282585dd could not be found. Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:58:01.956119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 648b822f-2ee2-4afd-8621-8462282585dd could not be found. Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 648b822f-2ee2-4afd-8621-8462282585dd could not be found. Jul 21 05:58:01.957736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:01.959203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Returning 404 to user: Instance 648b822f-2ee2-4afd-8621-8462282585dd could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:58:01.959203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-10425f0a-5289-4755-b48c-a649317b9edf tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd" status: 404 len: 111 microversion: 2.1 time: 0.036249 Jul 21 05:58:01.959203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 610/866] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:01 2022] GET /compute/v2.1/servers/648b822f-2ee2-4afd-8621-8462282585dd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:58:05.074357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:05.075001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:05.081681 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:05.082117 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:05.082870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:05.083346 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:05.109014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:58:05.191323 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-db1f8805-fc52-465f-9af4-bc613a39a55e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 204 len: 0 microversion: 2.1 time: 0.120404 Jul 21 05:58:05.191982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 611/867] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:58:05 2022] DELETE /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 05:58:05.197542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-337dc209-f8e2-449a-9e80-5a0091b9c1a1 req-722042ff-828d-44f7-b0ec-05e674eebe4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f7266ba-ea2e-43e6-b10c-313112fee2b0", "tag": "e5ae2355-4951-40f9-95fe-f387622b53fb"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:58:05.205576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-337dc209-f8e2-449a-9e80-5a0091b9c1a1 req-722042ff-828d-44f7-b0ec-05e674eebe4a service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:05.206017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-337dc209-f8e2-449a-9e80-5a0091b9c1a1 req-722042ff-828d-44f7-b0ec-05e674eebe4a service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:05.216879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-337dc209-f8e2-449a-9e80-5a0091b9c1a1 req-722042ff-828d-44f7-b0ec-05e674eebe4a service nova] Creating event network-changed:e5ae2355-4951-40f9-95fe-f387622b53fb for instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 on hv-cinder-85044 Jul 21 05:58:05.221651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-337dc209-f8e2-449a-9e80-5a0091b9c1a1 req-722042ff-828d-44f7-b0ec-05e674eebe4a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028076 Jul 21 05:58:05.222197 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 612/868] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:58:05.227210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:05.227904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:05.234107 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:05.234546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:05.235335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:05.235763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:05.370255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:05.378477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8744f2b4-79eb-4093-9cc9-54f6d31a77d8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1577 microversion: 2.1 time: 0.155055 Jul 21 05:58:05.379045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 613/869] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:05 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:06.396971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:06.397607 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:06.404709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:06.405187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:06.405939 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:06.406362 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:06.583617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:06.591662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-72435f07-2114-4c42-8d78-d675ed5ac9b8 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1577 microversion: 2.1 time: 0.198609 Jul 21 05:58:06.592192 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 614/870] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:06 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1577 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:07.608289 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:07.609033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:07.616104 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:07.616633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:07.617410 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:07.617851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:07.810381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17108265cfba44b29c362ac18bbf3e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6f9207778b4e0fbdbbae28c8f7b224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:07.818066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a7745591-76e9-4ffb-8bd8-0c4ee938319c tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 200 len: 1458 microversion: 2.1 time: 0.213716 Jul 21 05:58:07.818628 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 615/871] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:07 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 1458 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:58:07.888170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-5bd4243d-8f0f-49a6-a19b-f0bb18406f2c req-638e23cf-1756-49e0-a7e6-bbeb92213f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f7266ba-ea2e-43e6-b10c-313112fee2b0", "name": "network-vif-deleted", "tag": "e5ae2355-4951-40f9-95fe-f387622b53fb"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:58:07.896640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-5bd4243d-8f0f-49a6-a19b-f0bb18406f2c req-638e23cf-1756-49e0-a7e6-bbeb92213f93 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:07.897100 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-5bd4243d-8f0f-49a6-a19b-f0bb18406f2c req-638e23cf-1756-49e0-a7e6-bbeb92213f93 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:07.908831 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-5bd4243d-8f0f-49a6-a19b-f0bb18406f2c req-638e23cf-1756-49e0-a7e6-bbeb92213f93 service nova] Creating event network-vif-deleted:e5ae2355-4951-40f9-95fe-f387622b53fb for instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 on hv-cinder-85044 Jul 21 05:58:07.913678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-5bd4243d-8f0f-49a6-a19b-f0bb18406f2c req-638e23cf-1756-49e0-a7e6-bbeb92213f93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029133 Jul 21 05:58:07.914265 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 616/872] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:58:08.838268 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:08.839119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 9f7266ba-ea2e-43e6-b10c-313112fee2b0] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:08.847511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:08.848027 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:08.848981 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:08.849575 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:08.863862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] HTTP exception thrown: Instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 could not be found. Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Request method failure captured: Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 HTTP/1.1 Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OkBAyzXMXVOyXlNqf3WjnGrna9lyHWaG73PVmGhx44gAxUfXk7H1ejGqZ7L0amJhbdap4Xbpz1AT5GOn4O2qUEHfJdv6Kiwov7hLWaH-llQ8VJAzE3YuIyQXIXnjg-5--iKV38E_IAk72ZLHEWSeDuMUeiTwAc4Xo1MPUUl7-1wRC0 Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:58:08.865505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c6f9207778b4e0fbdbbae28c8f7b224", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}] Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 17108265cfba44b29c362ac18bbf3e20 Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 could not be found. Jul 21 05:58:08.867206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '9f7266ba-ea2e-43e6-b10c-313112fee2b0'} Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 could not be found. Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:58:08.868091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 could not be found. Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 could not be found. Jul 21 05:58:08.869367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:08.870519 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Returning 404 to user: Instance 9f7266ba-ea2e-43e6-b10c-313112fee2b0 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:58:08.870519 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-17e9adfa-8e92-4166-8351-1869d0ecd18e tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0" status: 404 len: 111 microversion: 2.1 time: 0.034641 Jul 21 05:58:08.870519 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 617/873] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:08 2022] GET /compute/v2.1/servers/9f7266ba-ea2e-43e6-b10c-313112fee2b0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:58:09.321969 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:09.322455 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:09.328503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:09.328942 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:09.329695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:09.330141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:09.343451 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] HTTP exception thrown: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Request method failure captured: Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 HTTP/1.1 Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OkBAyzXMXVOyXlNqf3WjnGrna9lyHWaG73PVmGhx44gAxUfXk7H1ejGqZ7L0amJhbdap4Xbpz1AT5GOn4O2qUEHfJdv6Kiwov7hLWaH-llQ8VJAzE3YuIyQXIXnjg-5--iKV38E_IAk72ZLHEWSeDuMUeiTwAc4Xo1MPUUl7-1wRC0 Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:58:09.344961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c6f9207778b4e0fbdbbae28c8f7b224", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}] Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 17108265cfba44b29c362ac18bbf3e20 Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.346381 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '119674ff-e339-4ec5-9d00-18ad40d627c3'} Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:58:09.347218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.348695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.350310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Returning 404 to user: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:58:09.350310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8f822ee0-de9a-4ff4-8540-313467fe71d3 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "DELETE /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 404 len: 111 microversion: 2.1 time: 0.028308 Jul 21 05:58:09.350310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 618/874] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:58:09 2022] DELETE /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:58:09.354464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:09.355224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] [instance: 119674ff-e339-4ec5-9d00-18ad40d627c3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:09.361199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:09.361641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:09.362411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:09.362838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:09.375772 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] HTTP exception thrown: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Request method failure captured: Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 HTTP/1.1 Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OkBAyzXMXVOyXlNqf3WjnGrna9lyHWaG73PVmGhx44gAxUfXk7H1ejGqZ7L0amJhbdap4Xbpz1AT5GOn4O2qUEHfJdv6Kiwov7hLWaH-llQ8VJAzE3YuIyQXIXnjg-5--iKV38E_IAk72ZLHEWSeDuMUeiTwAc4Xo1MPUUl7-1wRC0 Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:58:09.377250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c6f9207778b4e0fbdbbae28c8f7b224", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c6f9207778b4e0fbdbbae28c8f7b224"}]}] Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 0c6f9207778b4e0fbdbbae28c8f7b224 Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-TestVolumeBootPattern-552124233 Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 17108265cfba44b29c362ac18bbf3e20 Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-TestVolumeBootPattern-552124233-project Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.378959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '119674ff-e339-4ec5-9d00-18ad40d627c3'} Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:58:09.380074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. Jul 21 05:58:09.381569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:58:09.383072 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Returning 404 to user: Instance 119674ff-e339-4ec5-9d00-18ad40d627c3 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:58:09.383072 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5a71d0b3-f54f-4a3c-8aae-762aa394746f tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3" status: 404 len: 111 microversion: 2.1 time: 0.027691 Jul 21 05:58:09.383072 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 619/875] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:09 2022] GET /compute/v2.1/servers/119674ff-e339-4ec5-9d00-18ad40d627c3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:58:10.698940 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3970b2d8-37d0-4f1d-ac9f-9e854035e4a6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] Calling method '.version_select at 0x7f50904ebaf0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:10.718465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3970b2d8-37d0-4f1d-ac9f-9e854035e4a6 tempest-TestVolumeBootPattern-552124233 tempest-TestVolumeBootPattern-552124233-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-179865322" status: 202 len: 0 microversion: 2.1 time: 0.023396 Jul 21 05:58:10.719036 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 620/876] 10.222.0.44 () {58 vars in 1259 bytes} [Thu Jul 21 05:58:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-179865322 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:58:37.102107 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:37.102790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:37.107524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:37.108016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:37.115948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:37.116502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:37.117261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:37.117692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:37.200275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lazy-loading 'services' on Instance uuid 46154a5c-faff-482b-a77b-afd4abb0cfbc {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:58:37.277347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-74b61761-6d79-4c7b-bf5f-1ec166032072 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-volume_attachments/fb329e93-3d60-42ea-927b-77cb23f1c8f8" status: 202 len: 0 microversion: 2.1 time: 0.178041 Jul 21 05:58:37.277916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 621/877] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 05:58:37 2022] DELETE /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-volume_attachments/fb329e93-3d60-42ea-927b-77cb23f1c8f8 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:58:38.415355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6b185818-896a-4be9-a7b0-9e93b48980bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:58:38.422093 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6b185818-896a-4be9-a7b0-9e93b48980bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:38.422516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6b185818-896a-4be9-a7b0-9e93b48980bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:38.445538 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6b185818-896a-4be9-a7b0-9e93b48980bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Going to try to stop instance {{(pid=124328) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 05:58:38.489911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6b185818-896a-4be9-a7b0-9e93b48980bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action" status: 202 len: 0 microversion: 2.1 time: 0.079246 Jul 21 05:58:38.490502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 622/878] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:58:38 2022] POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:58:38.499040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:38.499763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:38.506095 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:38.506530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:38.507393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:38.507763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:38.641248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:38.649323 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bd4b8013-14b4-4a1a-8a32-5c073201f71c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.154247 Jul 21 05:58:38.649898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 623/879] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:38 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:58:39.666837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:39.667569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:39.674611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:39.675119 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:39.675911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:39.676352 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:39.818830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:39.831055 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-897b630e-78eb-4a8c-b691-1913f8381fab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.167832 Jul 21 05:58:39.831835 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 624/880] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:39 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:40.855321 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:40.856043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:40.863709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:40.864185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:40.865048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:40.865516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:41.220897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:41.228975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-48050664-6996-4783-ba4d-ba935d78ac3b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.380144 Jul 21 05:58:41.229555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 625/881] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:40 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:42.246703 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:42.247456 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:42.255053 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:42.255510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:42.256290 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:42.256712 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:42.420232 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:42.428165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5d8c7b6a-b937-42ab-9b20-6a7056a7d9ca tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.186165 Jul 21 05:58:42.428729 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 626/882] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:42 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:43.450348 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:43.451510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:43.461868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:43.462622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:43.463916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:43.464499 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:43.599781 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:43.607820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f2148987-5e96-4bed-93a4-5d597ab466be tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.164173 Jul 21 05:58:43.608379 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 627/883] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:43 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:44.628881 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:44.629766 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:44.638655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:44.639129 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:44.639881 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:44.640304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:44.772886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:44.781040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9f87df05-5130-4aea-9a39-9b8f888967fb tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.158626 Jul 21 05:58:44.781974 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 628/884] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:44 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:45.802926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:45.803988 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:45.812103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:45.812551 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:45.813309 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:45.813740 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:45.953850 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:45.961964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6db793ac-a444-4022-ac9f-1e50c1353506 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.165479 Jul 21 05:58:45.962503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 629/885] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:45 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:46.982446 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:46.983154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:46.990163 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:46.990608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:46.991412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:46.991842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:47.139000 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:47.146888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a9b238fc-6ade-4b25-a92a-490bf71b1236 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.169611 Jul 21 05:58:47.147492 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 630/886] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:46 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:48.168932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:48.169953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:48.180752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:48.181499 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:48.182711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:48.183523 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:48.322631 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:48.330869 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6ca21137-844b-4b15-991c-7a67882d1a3e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1676 microversion: 2.1 time: 0.168554 Jul 21 05:58:48.331465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 631/887] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:48 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:49.352444 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:49.353525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:49.364326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:49.365061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:49.366339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:49.367062 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:49.501796 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:49.514364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1321b2a5-f402-41db-a82d-2490c6ec06b9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1653 microversion: 2.1 time: 0.168185 Jul 21 05:58:49.515501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 632/888] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:49 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1653 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:49.536787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-085d6feb-a5bb-4321-8477-2865c5bb6431 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:58:49.542928 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-085d6feb-a5bb-4321-8477-2865c5bb6431 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:49.543397 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-085d6feb-a5bb-4321-8477-2865c5bb6431 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:49.565497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-085d6feb-a5bb-4321-8477-2865c5bb6431 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Going to try to start instance {{(pid=124328) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 05:58:49.611108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-085d6feb-a5bb-4321-8477-2865c5bb6431 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action" status: 202 len: 0 microversion: 2.1 time: 0.077676 Jul 21 05:58:49.611699 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 633/889] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 05:58:49 2022] POST /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:58:49.620977 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:49.621684 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:49.628367 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:49.628892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:49.629660 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:49.630190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:49.834168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:49.837714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:58:49.842406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4d082641-3a7c-4af6-919d-9ac934bea672 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1662 microversion: 2.1 time: 0.226051 Jul 21 05:58:49.842969 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 634/890] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:49 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:58:50.862366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:58:50.863138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:58:50.872348 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:50.872910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:50.873666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:58:50.874092 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:58:51.004123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:58:51.011651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6f0fc84c-26e0-4b49-84b3-d3c9caf70857 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1666 microversion: 2.1 time: 0.154896 Jul 21 05:58:51.012188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 635/891] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:58:50 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1666 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:58:51.299825 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 05:58:51.300763 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 05:58:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 05:58:52.412333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 05:58:52.413187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Thu Jul 21 05:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 05:59:05.867204 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 05:59:05.868014 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 05:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 05:59:54.255713 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=30 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:59:54.256454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=6 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 05:59:54.260826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d9a1c938-3402-4da4-a814-54fb27cf9b26 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:54.261810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d9a1c938-3402-4da4-a814-54fb27cf9b26 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:59:54.268961 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9a1c938-3402-4da4-a814-54fb27cf9b26 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:54.269396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9a1c938-3402-4da4-a814-54fb27cf9b26 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:54.270146 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9a1c938-3402-4da4-a814-54fb27cf9b26 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:54.270563 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d9a1c938-3402-4da4-a814-54fb27cf9b26 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:54.299544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d9a1c938-3402-4da4-a814-54fb27cf9b26 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045359 Jul 21 05:59:54.300074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 636/892] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 05:59:54 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 05:59:54.358904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:54.359417 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:59:54.365553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:54.366252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:54.367004 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:54.367460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:54.391709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 05:59:54.473612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f3a99872-ea7d-4da2-9a1f-43bfc44ebdaa tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 204 len: 0 microversion: 2.1 time: 0.118060 Jul 21 05:59:54.474237 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 637/893] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 05:59:54 2022] DELETE /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 05:59:54.485111 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:54.486143 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:59:54.495194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:54.495836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:54.496981 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:54.497629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:54.645717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:59:54.653791 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4503334a-24f5-482d-988a-5eab65c3d3a8 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1672 microversion: 2.1 time: 0.174967 Jul 21 05:59:54.654358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 638/894] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:59:54 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 05:59:55.672500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:55.673087 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:59:55.680243 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:55.680690 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:55.681453 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:55.681884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:55.816775 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:59:55.824672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-36d5f9ce-64c5-4291-a66f-378cf4793d50 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1672 microversion: 2.1 time: 0.156176 Jul 21 05:59:55.825239 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 639/895] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:59:55 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:59:56.846840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:56.847984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:59:56.858390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:56.858838 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:56.859639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:56.860072 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:57.084565 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:59:57.092727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-912c9711-c960-4616-8629-461ab5bbff67 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1672 microversion: 2.1 time: 0.252355 Jul 21 05:59:57.093259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 640/896] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:59:56 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1672 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:59:57.804007 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-4a92d558-f47b-4472-b272-03612bf0ec95 req-2dff1e88-257d-4a2b-b46f-a0cd87671984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46154a5c-faff-482b-a77b-afd4abb0cfbc", "name": "network-vif-deleted", "tag": "873310e1-56af-4c83-a4d9-81875a452116"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:59:57.811993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-4a92d558-f47b-4472-b272-03612bf0ec95 req-2dff1e88-257d-4a2b-b46f-a0cd87671984 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:57.812428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-4a92d558-f47b-4472-b272-03612bf0ec95 req-2dff1e88-257d-4a2b-b46f-a0cd87671984 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:57.824091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-4a92d558-f47b-4472-b272-03612bf0ec95 req-2dff1e88-257d-4a2b-b46f-a0cd87671984 service nova] Creating event network-vif-deleted:873310e1-56af-4c83-a4d9-81875a452116 for instance 46154a5c-faff-482b-a77b-afd4abb0cfbc on hv-cinder-85044 Jul 21 05:59:57.829672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-4a92d558-f47b-4472-b272-03612bf0ec95 req-2dff1e88-257d-4a2b-b46f-a0cd87671984 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030485 Jul 21 05:59:57.830647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 641/897] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 05:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 05:59:58.111758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:58.112445 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:59:58.120064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:58.120442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:58.121225 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:58.121664 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:58.154477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:58.154926 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:58.155411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lazy-loading 'fault' on Instance uuid 46154a5c-faff-482b-a77b-afd4abb0cfbc {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 05:59:58.197930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 05:59:58.206080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1fe6e28b-8dec-403a-9689-8dfdab38bb28 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 200 len: 1327 microversion: 2.1 time: 0.099225 Jul 21 05:59:58.206653 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 642/898] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:59:58 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 05:59:59.222848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:59.223590 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 05:59:59.230082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:59.230528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:59.231307 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 05:59:59.231736 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 05:59:59.245642 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] HTTP exception thrown: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Request method failure captured: Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc HTTP/1.1 Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OpWaH8uhz9gRyF8p5O0Ht8Z58tIJtYZEiw-e1aouNZAmLkMR3cJO1twnSNsTtnQSF4_TtpFJwnLz43nMhgFwbPy5uQX4IPHKH8UEPBb-6TNMPkL5LUkW8KCAWBtYYFj4Z3Q-vfeoz821LRnzG1I6U1UO0xsOk_ty5M_50APqTdp_Yo Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 05:59:59.247386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a3f30d9c29794ccfb52188216cd48085", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}] Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeTestJSON-599162746 Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeTestJSON-599162746-project Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: e5a03f7524f7436fbbd78a7778702d1b Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeTestJSON-599162746-project Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 05:59:59.249168 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '46154a5c-faff-482b-a77b-afd4abb0cfbc'} Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 05:59:59.250186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 05:59:59.251896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 05:59:59.253455 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Returning 404 to user: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 05:59:59.253455 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d4705f11-e8b6-4f8d-b01e-db96d8bbeeb4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 404 len: 111 microversion: 2.1 time: 0.029889 Jul 21 05:59:59.253455 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 643/899] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 05:59:59 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 05:59:59.259313 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-968166ef-710d-4570-b647-eca5bc5e70f9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '.version_select at 0x7f5090464a60>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 05:59:59.278103 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-968166ef-710d-4570-b647-eca5bc5e70f9 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301841332" status: 202 len: 0 microversion: 2.1 time: 0.022367 Jul 21 05:59:59.278920 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 644/900] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 05:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1301841332 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 05:59:59.912101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7d89ea30-7bf7-4b06-b9fb-755022d4466a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'create', calling method: .version_select at 0x7f509065db80>, body: {"keypair": {"name": "tempest-keypair-1852227241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXlJiHe9K+4epozW1q93Y+MUxBTs69kl5eNRg5i0SVBvAc+v/c40PI/CIsfBopQoVV19TZ2Bt2MuTQW+eVnDGqesggnjggTfCIEvV4yLlxjhDgUEFhBhbywDnXSDFpBUw=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 05:59:59.927668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-7d89ea30-7bf7-4b06-b9fb-755022d4466a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for project a3f30d9c29794ccfb52188216cd48085. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 05:59:59.931592 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-7d89ea30-7bf7-4b06-b9fb-755022d4466a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for user e5a03f7524f7436fbbd78a7778702d1b and project a3f30d9c29794ccfb52188216cd48085. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 05:59:59.955120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7d89ea30-7bf7-4b06-b9fb-755022d4466a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046939 Jul 21 05:59:59.955734 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 645/901] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 05:59:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:00:01.273859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-882234039", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6393ce2d-637a-46ff-b836-ae9c1c77c3e6"}], "security_groups": [{"name": "tempest-securitygroup--1642780466"}], "key_name": "tempest-keypair-1852227241", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:00:01.384399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] validate_networks() for [('6393ce2d-637a-46ff-b836-ae9c1c77c3e6', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:00:01.799059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:00:01.799483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:00:01.799953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:00:01.800359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:00:01.800766 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:00:01.813076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:01.813513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:01.814328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:01.814750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:01.832231 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for project a3f30d9c29794ccfb52188216cd48085. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:00:01.836649 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Getting quotas for user e5a03f7524f7436fbbd78a7778702d1b and project a3f30d9c29794ccfb52188216cd48085. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:00:01.848919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:00:01.851193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:00:01.899409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4f26cc33-ac38-4a69-b96a-c71d3c16b02c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630752 Jul 21 06:00:01.900319 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 646/902] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 06:00:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:00:01.910840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-91e5cd84-532d-4be4-858b-fbe0b0651216 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:01.911693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-91e5cd84-532d-4be4-858b-fbe0b0651216 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:01.965186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-91e5cd84-532d-4be4-858b-fbe0b0651216 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:01.974740 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-91e5cd84-532d-4be4-858b-fbe0b0651216 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1237 microversion: 2.1 time: 0.068003 Jul 21 06:00:01.975316 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 647/903] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:01 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:00:02.991923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bd2e799e-a9f0-4c41-b92b-59046efb698b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:02.992505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bd2e799e-a9f0-4c41-b92b-59046efb698b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:03.053738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bd2e799e-a9f0-4c41-b92b-59046efb698b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:03.060529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bd2e799e-a9f0-4c41-b92b-59046efb698b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1237 microversion: 2.1 time: 0.072485 Jul 21 06:00:03.061081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 648/904] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:02 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:04.077512 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-515e847e-d4be-4b0d-acf7-4bc1308bc13c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:04.078111 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-515e847e-d4be-4b0d-acf7-4bc1308bc13c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:04.131870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-515e847e-d4be-4b0d-acf7-4bc1308bc13c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:04.139472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-515e847e-d4be-4b0d-acf7-4bc1308bc13c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1237 microversion: 2.1 time: 0.065769 Jul 21 06:00:04.140031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 649/905] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:04 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:05.161312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b3d53b42-8732-4b2e-a3bc-5661eef5ad89 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:05.162422 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b3d53b42-8732-4b2e-a3bc-5661eef5ad89 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:05.230891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b3d53b42-8732-4b2e-a3bc-5661eef5ad89 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:05.238497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b3d53b42-8732-4b2e-a3bc-5661eef5ad89 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1237 microversion: 2.1 time: 0.084174 Jul 21 06:00:05.239202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 650/906] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:05 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:06.259891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:06.260902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:06.269717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:06.270188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:06.270936 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:06.271405 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:06.333269 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:06.341583 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cbc5b356-b546-4106-9045-cf631d39b39a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1241 microversion: 2.1 time: 0.088444 Jul 21 06:00:06.342152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 651/907] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:06 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:07.360064 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:07.361057 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:07.370273 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:07.370720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:07.372112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:07.373015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:07.454865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:07.462937 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-089f40a3-c382-432b-8b9d-e8d71ea616fc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1295 microversion: 2.1 time: 0.107614 Jul 21 06:00:07.463515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 652/908] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:07 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1295 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:08.480937 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:08.481599 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:08.489996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:08.490509 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:08.491806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:08.492343 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:08.713919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:08.722151 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-097feecf-09e7-4911-938c-19062e47cc75 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1363 microversion: 2.1 time: 0.245319 Jul 21 06:00:08.722727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 653/909] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:08 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:08.741315 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-31a43be2-30b5-4301-a303-d323b67a7cdf req-7663c89a-5380-4c19-a5f7-4e2f91ca574a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb425ead-2e6d-472e-971b-4b35aa643da9", "tag": "2bc18556-14e9-433f-9a16-2068bb3ff550"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:00:08.751568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-31a43be2-30b5-4301-a303-d323b67a7cdf req-7663c89a-5380-4c19-a5f7-4e2f91ca574a service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:08.752008 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-31a43be2-30b5-4301-a303-d323b67a7cdf req-7663c89a-5380-4c19-a5f7-4e2f91ca574a service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:08.764780 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-31a43be2-30b5-4301-a303-d323b67a7cdf req-7663c89a-5380-4c19-a5f7-4e2f91ca574a service nova] Creating event network-changed:2bc18556-14e9-433f-9a16-2068bb3ff550 for instance eb425ead-2e6d-472e-971b-4b35aa643da9 on hv-cinder-85044 Jul 21 06:00:08.770345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-31a43be2-30b5-4301-a303-d323b67a7cdf req-7663c89a-5380-4c19-a5f7-4e2f91ca574a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034440 Jul 21 06:00:08.771352 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 654/910] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:00:09.743704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:09.744740 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:09.753654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:09.754101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:09.754862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:09.755328 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:09.893991 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:09.901853 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7a623212-8323-4ffa-a49a-5723779803d1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1363 microversion: 2.1 time: 0.165432 Jul 21 06:00:09.902394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 655/911] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:09 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:10.924070 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:10.924826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:10.932803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:10.933329 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:10.934219 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:10.934734 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:11.073241 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:11.081261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-691d9c48-7162-47ea-8905-2740a077e367 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1363 microversion: 2.1 time: 0.163949 Jul 21 06:00:11.081833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 656/912] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:10 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:12.098798 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:12.099518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:12.101412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:00:12.107528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:12.107968 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:12.108703 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:12.109126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:12.251985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:12.260032 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-12eeaa44-b6a1-49a3-a0f7-e9f2f5a96bee tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1363 microversion: 2.1 time: 0.165150 Jul 21 06:00:12.260587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 657/913] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:12 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:13.282116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:13.283209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:13.290044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:13.290517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:13.291356 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:13.291818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:13.432963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:13.441158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c7565d42-e500-429e-b76b-5136eeb9833c tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1363 microversion: 2.1 time: 0.166455 Jul 21 06:00:13.441769 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 658/914] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:13 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:14.458110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:14.458830 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:14.465590 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:14.466029 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:14.466783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:14.467246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:14.471182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:00:14.604287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:14.611936 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cb922060-9446-4248-8774-28f94fbe7441 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1363 microversion: 2.1 time: 0.157964 Jul 21 06:00:14.612504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 659/915] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:14 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:14.616864 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-a79bb9f0-b9e2-4431-999a-aa0ac9b4be50 req-83e3549e-f5df-45d6-a354-4580a3d027de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb425ead-2e6d-472e-971b-4b35aa643da9", "name": "network-vif-plugged", "status": "completed", "tag": "2bc18556-14e9-433f-9a16-2068bb3ff550"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:00:14.624732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a79bb9f0-b9e2-4431-999a-aa0ac9b4be50 req-83e3549e-f5df-45d6-a354-4580a3d027de service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:14.625343 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a79bb9f0-b9e2-4431-999a-aa0ac9b4be50 req-83e3549e-f5df-45d6-a354-4580a3d027de service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:14.636940 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-a79bb9f0-b9e2-4431-999a-aa0ac9b4be50 req-83e3549e-f5df-45d6-a354-4580a3d027de service nova] Creating event network-vif-plugged:2bc18556-14e9-433f-9a16-2068bb3ff550 for instance eb425ead-2e6d-472e-971b-4b35aa643da9 on hv-cinder-85044 Jul 21 06:00:14.641824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-a79bb9f0-b9e2-4431-999a-aa0ac9b4be50 req-83e3549e-f5df-45d6-a354-4580a3d027de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028216 Jul 21 06:00:14.642463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 660/916] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:00:15.629364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=18 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:00:15.634977 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:15.635878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:15.644150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:15.644709 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:15.645647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:15.646197 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:15.784623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:15.795829 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6ee03241-0117-41f7-adb5-cf3652691f4b tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1363 microversion: 2.1 time: 0.168285 Jul 21 06:00:15.796438 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 661/917] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:15 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:16.814095 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:16.814799 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:16.821677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:16.822152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:16.822912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:16.823390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:16.968879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:00:16.976611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-85002d30-0d60-47ef-922c-c91ca6e115dc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1549 microversion: 2.1 time: 0.166597 Jul 21 06:00:16.977171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 662/918] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:00:16 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:00:16.992982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d8417110-5168-4b22-b1d1-53d2e414799e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:00:16.993466 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d8417110-5168-4b22-b1d1-53d2e414799e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:00:16.996294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:00:16.999938 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8417110-5168-4b22-b1d1-53d2e414799e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:17.000375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8417110-5168-4b22-b1d1-53d2e414799e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:17.001122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8417110-5168-4b22-b1d1-53d2e414799e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:17.001547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d8417110-5168-4b22-b1d1-53d2e414799e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:17.080186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d8417110-5168-4b22-b1d1-53d2e414799e tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090915 Jul 21 06:00:17.080783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 663/919] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 06:00:16 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:00:18.044373 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-1fcd8342-50a1-48f5-ad3a-b841c25f3ecd req-c1069458-81f1-4cdb-bb0a-7ab041629498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb425ead-2e6d-472e-971b-4b35aa643da9", "tag": "2bc18556-14e9-433f-9a16-2068bb3ff550"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:00:18.052704 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1fcd8342-50a1-48f5-ad3a-b841c25f3ecd req-c1069458-81f1-4cdb-bb0a-7ab041629498 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:00:18.053153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-1fcd8342-50a1-48f5-ad3a-b841c25f3ecd req-c1069458-81f1-4cdb-bb0a-7ab041629498 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:00:18.064451 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-1fcd8342-50a1-48f5-ad3a-b841c25f3ecd req-c1069458-81f1-4cdb-bb0a-7ab041629498 service nova] Creating event network-changed:2bc18556-14e9-433f-9a16-2068bb3ff550 for instance eb425ead-2e6d-472e-971b-4b35aa643da9 on hv-cinder-85044 Jul 21 06:00:18.069406 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-1fcd8342-50a1-48f5-ad3a-b841c25f3ecd req-c1069458-81f1-4cdb-bb0a-7ab041629498 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029176 Jul 21 06:00:18.070230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 664/920] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:01:22.694402 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:01:22.695193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=24 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:01:22.759390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a5c02a3b-98cb-4dc7-a5db-51369ad3214a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:22.760208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a5c02a3b-98cb-4dc7-a5db-51369ad3214a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:22.768656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5c02a3b-98cb-4dc7-a5db-51369ad3214a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:22.769098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5c02a3b-98cb-4dc7-a5db-51369ad3214a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:22.769856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5c02a3b-98cb-4dc7-a5db-51369ad3214a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:22.770282 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a5c02a3b-98cb-4dc7-a5db-51369ad3214a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:22.795355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a5c02a3b-98cb-4dc7-a5db-51369ad3214a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/ips" status: 200 len: 146 microversion: 2.1 time: 0.103194 Jul 21 06:01:22.795901 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 665/921] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 06:01:22 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/ips => generated 146 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:01:24.131780 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-44253e90-1fa1-453e-8b54-52b5935ce7f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "084272bf-06a3-4dd9-b9f0-63f3e2810c07"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:01:24.132915 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-44253e90-1fa1-453e-8b54-52b5935ce7f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:24.140138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44253e90-1fa1-453e-8b54-52b5935ce7f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:24.140586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44253e90-1fa1-453e-8b54-52b5935ce7f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:24.141354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44253e90-1fa1-453e-8b54-52b5935ce7f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:24.141889 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-44253e90-1fa1-453e-8b54-52b5935ce7f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:24.435359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-44253e90-1fa1-453e-8b54-52b5935ce7f1 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307397 Jul 21 06:01:24.435971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 666/922] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 06:01:24 2022] POST /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:01:31.971611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-db451740-dd72-4e74-be4e-c2316922b5f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:31.972617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-db451740-dd72-4e74-be4e-c2316922b5f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:31.978953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db451740-dd72-4e74-be4e-c2316922b5f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:31.979436 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db451740-dd72-4e74-be4e-c2316922b5f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:31.980228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db451740-dd72-4e74-be4e-c2316922b5f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:31.980656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-db451740-dd72-4e74-be4e-c2316922b5f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:32.009880 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-db451740-dd72-4e74-be4e-c2316922b5f4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Jul 21 06:01:32.010416 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 667/923] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:01:31 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:01:32.019927 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3772854e-7f5d-4825-ab78-d613b3714ee6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:32.020409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3772854e-7f5d-4825-ab78-d613b3714ee6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:32.026226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3772854e-7f5d-4825-ab78-d613b3714ee6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:32.026703 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3772854e-7f5d-4825-ab78-d613b3714ee6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:32.027495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3772854e-7f5d-4825-ab78-d613b3714ee6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:32.027924 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3772854e-7f5d-4825-ab78-d613b3714ee6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:32.056137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3772854e-7f5d-4825-ab78-d613b3714ee6 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/084272bf-06a3-4dd9-b9f0-63f3e2810c07" status: 200 len: 194 microversion: 2.1 time: 0.039771 Jul 21 06:01:32.056683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 668/924] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jul 21 06:01:32 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/084272bf-06a3-4dd9-b9f0-63f3e2810c07 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:01:33.395461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c5749d57-d8cb-4a30-8814-907d13d5943f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94909f96-409b-4ed2-9292-a7c9337272ce"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:01:33.397687 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c5749d57-d8cb-4a30-8814-907d13d5943f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:33.408152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5749d57-d8cb-4a30-8814-907d13d5943f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:33.408589 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5749d57-d8cb-4a30-8814-907d13d5943f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:33.409339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5749d57-d8cb-4a30-8814-907d13d5943f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:33.409765 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c5749d57-d8cb-4a30-8814-907d13d5943f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:33.696134 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c5749d57-d8cb-4a30-8814-907d13d5943f tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "POST /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304535 Jul 21 06:01:33.696725 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 669/925] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 06:01:33 2022] POST /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:01:41.265956 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-96020f1f-af3e-4e05-902f-c895792464b4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:41.267255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-96020f1f-af3e-4e05-902f-c895792464b4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:41.275516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96020f1f-af3e-4e05-902f-c895792464b4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:41.275957 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96020f1f-af3e-4e05-902f-c895792464b4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:41.276708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96020f1f-af3e-4e05-902f-c895792464b4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:41.277132 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-96020f1f-af3e-4e05-902f-c895792464b4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:41.308283 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-96020f1f-af3e-4e05-902f-c895792464b4 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049557 Jul 21 06:01:41.308823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 670/926] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:01:41 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:01:41.460702 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-aafefe57-c31a-4f9b-bc30-7e756c3530bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:41.463652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-aafefe57-c31a-4f9b-bc30-7e756c3530bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:41.473397 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aafefe57-c31a-4f9b-bc30-7e756c3530bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:41.474038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aafefe57-c31a-4f9b-bc30-7e756c3530bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:41.475217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aafefe57-c31a-4f9b-bc30-7e756c3530bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:41.475779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-aafefe57-c31a-4f9b-bc30-7e756c3530bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:41.508949 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-aafefe57-c31a-4f9b-bc30-7e756c3530bc tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/084272bf-06a3-4dd9-b9f0-63f3e2810c07" status: 200 len: 194 microversion: 2.1 time: 0.053590 Jul 21 06:01:41.509508 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 671/927] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jul 21 06:01:41 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/084272bf-06a3-4dd9-b9f0-63f3e2810c07 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:01:41.520525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:41.521011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:41.526919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:41.527399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:41.528146 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:41.528577 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:41.617627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lazy-loading 'services' on Instance uuid eb425ead-2e6d-472e-971b-4b35aa643da9 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:01:41.699340 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-43328250-b50e-43dc-8d8f-86dca06b385d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/084272bf-06a3-4dd9-b9f0-63f3e2810c07" status: 202 len: 0 microversion: 2.1 time: 0.182220 Jul 21 06:01:41.699931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 672/928] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 06:01:41 2022] DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/084272bf-06a3-4dd9-b9f0-63f3e2810c07 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:01:42.813245 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8aba67e5-2509-416e-b8a5-adabdbf504ab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:42.813982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8aba67e5-2509-416e-b8a5-adabdbf504ab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:42.820205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8aba67e5-2509-416e-b8a5-adabdbf504ab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:42.820638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8aba67e5-2509-416e-b8a5-adabdbf504ab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:42.821390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8aba67e5-2509-416e-b8a5-adabdbf504ab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:42.821813 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8aba67e5-2509-416e-b8a5-adabdbf504ab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:42.851190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8aba67e5-2509-416e-b8a5-adabdbf504ab tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/94909f96-409b-4ed2-9292-a7c9337272ce" status: 200 len: 194 microversion: 2.1 time: 0.042684 Jul 21 06:01:42.851775 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 673/929] 10.222.0.44 () {58 vars in 1412 bytes} [Thu Jul 21 06:01:42 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/94909f96-409b-4ed2-9292-a7c9337272ce => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:01:42.861452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:42.861923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:42.868407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:42.868861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:42.869621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:42.870035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:42.951558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lazy-loading 'services' on Instance uuid eb425ead-2e6d-472e-971b-4b35aa643da9 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:01:43.030102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e0342504-8585-447d-988b-26a70b133174 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/94909f96-409b-4ed2-9292-a7c9337272ce" status: 202 len: 0 microversion: 2.1 time: 0.172127 Jul 21 06:01:43.030876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 674/930] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 06:01:42 2022] DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments/94909f96-409b-4ed2-9292-a7c9337272ce => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:01:44.205122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-eff160d5-527c-481b-9ba5-06eea422caef tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:44.206136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-eff160d5-527c-481b-9ba5-06eea422caef tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:44.213234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eff160d5-527c-481b-9ba5-06eea422caef tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.213679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eff160d5-527c-481b-9ba5-06eea422caef tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.214444 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eff160d5-527c-481b-9ba5-06eea422caef tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.214877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eff160d5-527c-481b-9ba5-06eea422caef tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.244612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-eff160d5-527c-481b-9ba5-06eea422caef tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044493 Jul 21 06:01:44.245191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 675/931] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:01:44 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:01:44.371458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0dfc85d1-ba8b-45b0-8169-049b4a4d6883 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:44.372385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0dfc85d1-ba8b-45b0-8169-049b4a4d6883 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:44.378738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0dfc85d1-ba8b-45b0-8169-049b4a4d6883 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.379224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0dfc85d1-ba8b-45b0-8169-049b4a4d6883 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.379976 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0dfc85d1-ba8b-45b0-8169-049b4a4d6883 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.380399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0dfc85d1-ba8b-45b0-8169-049b4a4d6883 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.408986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0dfc85d1-ba8b-45b0-8169-049b4a4d6883 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041483 Jul 21 06:01:44.409521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 676/932] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:01:44 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:01:44.479504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:44.480158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:44.488954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.489485 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.490235 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.490661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.514663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:01:44.517419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:01:44.591082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f084e3e4-a8e0-419d-a8ba-a43b07786502 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 204 len: 0 microversion: 2.1 time: 0.117157 Jul 21 06:01:44.591651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 677/933] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:01:44 2022] DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:01:44.600541 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:44.601246 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:44.607430 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.607818 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.608584 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:44.609018 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:44.740549 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:01:44.748410 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7668fde2-ef2b-4f0a-bc0d-284a444ec5d0 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1674 microversion: 2.1 time: 0.151829 Jul 21 06:01:44.748979 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 678/934] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:01:44 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:01:45.768955 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:45.769747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:45.777257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:45.777711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:45.778486 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:45.778923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:45.931447 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:01:45.939179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4dedf7dd-283b-4efd-8035-fd85af8d0168 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1674 microversion: 2.1 time: 0.176452 Jul 21 06:01:45.939744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 679/935] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:01:45 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:01:46.957171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:46.957810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:46.965544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:46.965992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:46.966764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:46.967357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:47.174616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5a03f7524f7436fbbd78a7778702d1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3f30d9c29794ccfb52188216cd48085', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:01:47.182796 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8062f1f2-98d2-418a-9091-6f15783a455d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 200 len: 1674 microversion: 2.1 time: 0.229505 Jul 21 06:01:47.183401 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 680/936] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:01:46 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:01:47.760345 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-09e96d97-4b70-47cc-8252-b7c8b4e01629 req-fe38d5c3-7219-4998-aae6-f79978473914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb425ead-2e6d-472e-971b-4b35aa643da9", "name": "network-vif-deleted", "tag": "2bc18556-14e9-433f-9a16-2068bb3ff550"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:01:47.776102 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-09e96d97-4b70-47cc-8252-b7c8b4e01629 req-fe38d5c3-7219-4998-aae6-f79978473914 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:47.776564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-09e96d97-4b70-47cc-8252-b7c8b4e01629 req-fe38d5c3-7219-4998-aae6-f79978473914 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:47.790523 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-09e96d97-4b70-47cc-8252-b7c8b4e01629 req-fe38d5c3-7219-4998-aae6-f79978473914 service nova] Creating event network-vif-deleted:2bc18556-14e9-433f-9a16-2068bb3ff550 for instance eb425ead-2e6d-472e-971b-4b35aa643da9 on hv-cinder-85044 Jul 21 06:01:47.795747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-09e96d97-4b70-47cc-8252-b7c8b4e01629 req-fe38d5c3-7219-4998-aae6-f79978473914 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185262 Jul 21 06:01:47.796427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 681/937] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:01:48.201592 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:48.202335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:48.208826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:48.209277 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:48.210048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:48.210515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:48.224179 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] HTTP exception thrown: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Request method failure captured: Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 HTTP/1.1 Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OpWaH8uhz9gRyF8p5O0Ht8Z58tIJtYZEiw-e1aouNZAmLkMR3cJO1twnSNsTtnQSF4_TtpFJwnLz43nMhgFwbPy5uQX4IPHKH8UEPBb-6TNMPkL5LUkW8KCAWBtYYFj4Z3Q-vfeoz821LRnzG1I6U1UO0xsOk_ty5M_50APqTdp_Yo Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:01:48.225897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a3f30d9c29794ccfb52188216cd48085", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}] Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: e5a03f7524f7436fbbd78a7778702d1b Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:48.227688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'eb425ead-2e6d-472e-971b-4b35aa643da9'} Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:01:48.228540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:48.229919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:48.231209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Returning 404 to user: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:01:48.231209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-91da9a2c-10ea-43ac-818f-8faeafd82a2d tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 404 len: 111 microversion: 2.1 time: 0.030720 Jul 21 06:01:48.231209 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 682/938] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:01:48 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:01:48.236018 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-68890963-cf1b-4d29-8b99-c97d011c0dde tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '.version_select at 0x7f509052caf0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:48.256005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-68890963-cf1b-4d29-8b99-c97d011c0dde tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852227241" status: 202 len: 0 microversion: 2.1 time: 0.023373 Jul 21 06:01:48.256852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 683/939] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 06:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1852227241 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:01:51.193933 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:51.194652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:51.201627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:51.202066 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:51.202817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:51.203274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:51.217039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] HTTP exception thrown: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Request method failure captured: Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 HTTP/1.1 Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OpWaH8uhz9gRyF8p5O0Ht8Z58tIJtYZEiw-e1aouNZAmLkMR3cJO1twnSNsTtnQSF4_TtpFJwnLz43nMhgFwbPy5uQX4IPHKH8UEPBb-6TNMPkL5LUkW8KCAWBtYYFj4Z3Q-vfeoz821LRnzG1I6U1UO0xsOk_ty5M_50APqTdp_Yo Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:01:51.218562 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a3f30d9c29794ccfb52188216cd48085", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}] Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: e5a03f7524f7436fbbd78a7778702d1b Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.220228 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'eb425ead-2e6d-472e-971b-4b35aa643da9'} Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:01:51.225216 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.226643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.228061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Returning 404 to user: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:01:51.228061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bc61da01-6979-4daa-b4ab-a5b669266895 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 404 len: 111 microversion: 2.1 time: 0.030464 Jul 21 06:01:51.228061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 684/940] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:01:51 2022] DELETE /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:01:51.229167 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:51.230042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: eb425ead-2e6d-472e-971b-4b35aa643da9] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:51.238770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:51.239435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:51.240568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:51.241294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:51.260289 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] HTTP exception thrown: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Request method failure captured: Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 HTTP/1.1 Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OpWaH8uhz9gRyF8p5O0Ht8Z58tIJtYZEiw-e1aouNZAmLkMR3cJO1twnSNsTtnQSF4_TtpFJwnLz43nMhgFwbPy5uQX4IPHKH8UEPBb-6TNMPkL5LUkW8KCAWBtYYFj4Z3Q-vfeoz821LRnzG1I6U1UO0xsOk_ty5M_50APqTdp_Yo Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:01:51.261817 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a3f30d9c29794ccfb52188216cd48085", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}] Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: e5a03f7524f7436fbbd78a7778702d1b Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.263349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'eb425ead-2e6d-472e-971b-4b35aa643da9'} Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:01:51.264272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. Jul 21 06:01:51.265692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:51.267420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Returning 404 to user: Instance eb425ead-2e6d-472e-971b-4b35aa643da9 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:01:51.267420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8b1a3ea4-3a2e-49c0-b9e0-75e6fbc9fc1a tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9" status: 404 len: 111 microversion: 2.1 time: 0.037832 Jul 21 06:01:51.267420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 685/941] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:01:51 2022] GET /compute/v2.1/servers/eb425ead-2e6d-472e-971b-4b35aa643da9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:01:52.417001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:52.417608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:52.424565 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:52.425020 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:52.425784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:52.426218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:52.439995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] HTTP exception thrown: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Request method failure captured: Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc HTTP/1.1 Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OpWaH8uhz9gRyF8p5O0Ht8Z58tIJtYZEiw-e1aouNZAmLkMR3cJO1twnSNsTtnQSF4_TtpFJwnLz43nMhgFwbPy5uQX4IPHKH8UEPBb-6TNMPkL5LUkW8KCAWBtYYFj4Z3Q-vfeoz821LRnzG1I6U1UO0xsOk_ty5M_50APqTdp_Yo Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:01:52.441550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a3f30d9c29794ccfb52188216cd48085", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}] Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: e5a03f7524f7436fbbd78a7778702d1b Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.443120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '46154a5c-faff-482b-a77b-afd4abb0cfbc'} Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:01:52.444170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.445747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.447437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Returning 404 to user: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:01:52.447437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2ae2d927-6833-4c48-8a1c-a60cb16f52a7 tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "DELETE /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 404 len: 111 microversion: 2.1 time: 0.029829 Jul 21 06:01:52.447437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 686/942] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:01:52 2022] DELETE /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:01:52.450714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:01:52.451327 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] [instance: 46154a5c-faff-482b-a77b-afd4abb0cfbc] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:01:52.457047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:52.457491 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:52.458243 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:01:52.458675 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:01:52.471750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] HTTP exception thrown: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Request method failure captured: Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc HTTP/1.1 Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OpWaH8uhz9gRyF8p5O0Ht8Z58tIJtYZEiw-e1aouNZAmLkMR3cJO1twnSNsTtnQSF4_TtpFJwnLz43nMhgFwbPy5uQX4IPHKH8UEPBb-6TNMPkL5LUkW8KCAWBtYYFj4Z3Q-vfeoz821LRnzG1I6U1UO0xsOk_ty5M_50APqTdp_Yo Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:01:52.473226 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a3f30d9c29794ccfb52188216cd48085", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a3f30d9c29794ccfb52188216cd48085"}]}] Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: a3f30d9c29794ccfb52188216cd48085 Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeTestJSON-599162746 Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: e5a03f7524f7436fbbd78a7778702d1b Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeTestJSON-599162746-project Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.474859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '46154a5c-faff-482b-a77b-afd4abb0cfbc'} Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:01:52.476002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. Jul 21 06:01:52.477525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:01:52.479169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] Returning 404 to user: Instance 46154a5c-faff-482b-a77b-afd4abb0cfbc could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:01:52.479169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-de15fcc6-c9aa-4e67-a6d8-2c6e6d356bac tempest-AttachVolumeTestJSON-599162746 tempest-AttachVolumeTestJSON-599162746-project] 10.222.0.44 "GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc" status: 404 len: 111 microversion: 2.1 time: 0.027264 Jul 21 06:01:52.479169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 687/943] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:01:52 2022] GET /compute/v2.1/servers/46154a5c-faff-482b-a77b-afd4abb0cfbc => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 06:02:01.202911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-868f056b-b4d5-43f8-9292-479a02512931 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: .version_select at 0x7f5090582820>, body: {"keypair": {"name": "tempest-keypair-306138087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpIL2JHjOtdi+oSsIyV5X9PGCpTQj85LGaNhiHbV+CXvytQfwbRkkelG8bD8pHyEPoPp9cnttioI/LAtuthZXottEgVzQreDaqF1tAM/foSHYyGrpi1XqoIza5+XHkiQg=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:02:01.207100 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:02:01.221537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-868f056b-b4d5-43f8-9292-479a02512931 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:02:01.225759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-868f056b-b4d5-43f8-9292-479a02512931 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:02:01.250148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-868f056b-b4d5-43f8-9292-479a02512931 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.212975 Jul 21 06:02:01.250745 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 688/944] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 06:02:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:02:02.557299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:02:02.562140 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1560837935", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93367d36-116c-48ff-a4df-ca52ccc55a9c"}], "security_groups": [{"name": "tempest-securitygroup--688737124"}], "key_name": "tempest-keypair-306138087", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:02:02.668985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] validate_networks() for [('93367d36-116c-48ff-a4df-ca52ccc55a9c', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:02:03.064076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:02:03.064499 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:02:03.064963 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:02:03.065369 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:02:03.065773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:02:03.075152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:03.075603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:03.076395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:03.076815 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:03.096443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:02:03.100675 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:02:03.114115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:02:03.116854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:02:03.168421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-819360e2-f5f9-4e36-af49-b5b8b06f6ca2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612070 Jul 21 06:02:03.174030 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 689/945] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 06:02:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 06:02:03.180865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bc2b3bc6-9139-47e0-9012-55c0c1d2bb13 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:03.181738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bc2b3bc6-9139-47e0-9012-55c0c1d2bb13 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:03.242692 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bc2b3bc6-9139-47e0-9012-55c0c1d2bb13 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:03.252746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bc2b3bc6-9139-47e0-9012-55c0c1d2bb13 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1241 microversion: 2.1 time: 0.077159 Jul 21 06:02:03.253851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 690/946] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:03 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:02:04.271056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0fbfa8d0-0301-4579-8d18-92ac2d9ad4bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:04.271622 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0fbfa8d0-0301-4579-8d18-92ac2d9ad4bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:04.363397 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0fbfa8d0-0301-4579-8d18-92ac2d9ad4bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:04.370593 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0fbfa8d0-0301-4579-8d18-92ac2d9ad4bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1241 microversion: 2.1 time: 0.104696 Jul 21 06:02:04.380807 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 691/947] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:04 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:05.391073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ea2c033e-8598-4568-9754-cfa8f7fd7aad tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:05.392128 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ea2c033e-8598-4568-9754-cfa8f7fd7aad tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:05.450204 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ea2c033e-8598-4568-9754-cfa8f7fd7aad tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:05.457206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ea2c033e-8598-4568-9754-cfa8f7fd7aad tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1241 microversion: 2.1 time: 0.072560 Jul 21 06:02:05.457898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 692/948] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:05 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:06.478292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c3265377-d427-4e73-b52b-12ed7883a6e6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:06.479390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c3265377-d427-4e73-b52b-12ed7883a6e6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:06.537788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c3265377-d427-4e73-b52b-12ed7883a6e6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:06.546796 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c3265377-d427-4e73-b52b-12ed7883a6e6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1241 microversion: 2.1 time: 0.074938 Jul 21 06:02:06.547739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 693/949] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:06 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:07.565316 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:07.566005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:07.574819 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:07.575360 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:07.576236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:07.576737 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:07.639773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:07.649196 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5b09a3f0-cf00-48b4-9f4f-77a4306aa282 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1245 microversion: 2.1 time: 0.088430 Jul 21 06:02:07.649761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 694/950] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:07 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:08.666792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:08.667448 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:08.674482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:08.674916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:08.675723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:08.676155 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:08.752811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:08.760390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2eed403c-5301-4726-91a5-a27a95bafd7d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1299 microversion: 2.1 time: 0.097569 Jul 21 06:02:08.761193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 695/951] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:08 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:09.778044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:09.778722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:09.786419 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:09.786706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:09.787510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:09.788122 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:09.998013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:10.007777 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-155ce93b-ab45-4e82-871f-b358df9ac553 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1366 microversion: 2.1 time: 0.233616 Jul 21 06:02:10.017433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 696/952] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:09 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:02:10.021782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-2cc309b0-23da-459e-8eec-6699638ced7a req-6f2c67af-d701-4f82-b028-febf246f5cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0749710-36f7-4f07-91de-d8bb6912e4cd", "tag": "98b02187-4655-44f8-a5e3-e0b8bb09400f"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:02:10.030575 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2cc309b0-23da-459e-8eec-6699638ced7a req-6f2c67af-d701-4f82-b028-febf246f5cd6 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:10.031099 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2cc309b0-23da-459e-8eec-6699638ced7a req-6f2c67af-d701-4f82-b028-febf246f5cd6 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:10.043260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-2cc309b0-23da-459e-8eec-6699638ced7a req-6f2c67af-d701-4f82-b028-febf246f5cd6 service nova] Creating event network-changed:98b02187-4655-44f8-a5e3-e0b8bb09400f for instance a0749710-36f7-4f07-91de-d8bb6912e4cd on hv-cinder-85044 Jul 21 06:02:10.048615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-2cc309b0-23da-459e-8eec-6699638ced7a req-6f2c67af-d701-4f82-b028-febf246f5cd6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038375 Jul 21 06:02:10.049285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 697/953] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:02:11.030254 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:11.030982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:11.039166 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:11.039680 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:11.040558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:11.041056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:11.176017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:11.187748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-acc5fe1a-8a1a-44e1-81da-d208d23a815e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1366 microversion: 2.1 time: 0.164208 Jul 21 06:02:11.188633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 698/954] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:11 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:11.313492 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:02:11.314342 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:02:12.213631 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:12.214556 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:12.223530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:12.224151 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:12.225280 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:12.225852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:12.371242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:12.379666 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d4a28660-62bf-4da1-8bc9-fc5d4277c1a7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1366 microversion: 2.1 time: 0.172652 Jul 21 06:02:12.380225 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 699/955] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:12 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:13.401158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:13.402194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:13.405378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:02:13.414868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:13.415663 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:13.417255 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:13.418003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:13.552595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:13.560259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f467d82e-68b9-48a5-a637-86b36cc7ebd2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1366 microversion: 2.1 time: 0.165849 Jul 21 06:02:13.560839 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 700/956] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:13 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:14.581799 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:14.582831 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:14.593105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:14.593548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:14.594332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:14.594758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:14.731038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:14.738965 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9bed4041-9d8b-40ab-991b-5cf9973bf755 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1366 microversion: 2.1 time: 0.163855 Jul 21 06:02:14.739559 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 701/957] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:14 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:02:15.434853 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-05a8266a-49e5-4fad-8b44-4c9440edf814 req-adf90b9c-ecae-4f55-804c-93fd5aa235d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0749710-36f7-4f07-91de-d8bb6912e4cd", "name": "network-vif-plugged", "status": "completed", "tag": "98b02187-4655-44f8-a5e3-e0b8bb09400f"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:02:15.444261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-05a8266a-49e5-4fad-8b44-4c9440edf814 req-adf90b9c-ecae-4f55-804c-93fd5aa235d8 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:15.444693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-05a8266a-49e5-4fad-8b44-4c9440edf814 req-adf90b9c-ecae-4f55-804c-93fd5aa235d8 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:15.455545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-05a8266a-49e5-4fad-8b44-4c9440edf814 req-adf90b9c-ecae-4f55-804c-93fd5aa235d8 service nova] Creating event network-vif-plugged:98b02187-4655-44f8-a5e3-e0b8bb09400f for instance a0749710-36f7-4f07-91de-d8bb6912e4cd on hv-cinder-85044 Jul 21 06:02:15.460464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-05a8266a-49e5-4fad-8b44-4c9440edf814 req-adf90b9c-ecae-4f55-804c-93fd5aa235d8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088892 Jul 21 06:02:15.461005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 702/958] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:02:15.757432 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:15.758141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:15.765503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:15.765953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:15.766754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:15.767236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:15.905627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:15.914384 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8bc4115b-c236-49c7-971d-4e5d9fd731df tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1366 microversion: 2.1 time: 0.161370 Jul 21 06:02:15.914907 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 703/959] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:15 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:16.935489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:16.936540 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:16.938925 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=18 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:02:16.945304 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:16.945761 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:16.946554 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:16.947003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:17.090950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:17.103202 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-622dc04d-e246-4de1-bbd8-4ee282b0b9ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1366 microversion: 2.1 time: 0.173841 Jul 21 06:02:17.103931 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 704/960] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:16 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:18.125229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:18.126056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:18.134878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:18.135507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:18.136504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:18.137074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:18.277637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:02:18.285849 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c48d244f-0c01-4308-9619-57206a3f69e0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1556 microversion: 2.1 time: 0.167307 Jul 21 06:02:18.286382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 705/961] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:02:18 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:02:18.302378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f00d24ee-a04c-4cb3-acb0-04e334de9f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:02:18.302858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f00d24ee-a04c-4cb3-acb0-04e334de9f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:02:18.309061 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f00d24ee-a04c-4cb3-acb0-04e334de9f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:18.309500 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f00d24ee-a04c-4cb3-acb0-04e334de9f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:18.310252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f00d24ee-a04c-4cb3-acb0-04e334de9f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:18.310674 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f00d24ee-a04c-4cb3-acb0-04e334de9f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:18.395762 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f00d24ee-a04c-4cb3-acb0-04e334de9f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096431 Jul 21 06:02:18.396567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 706/962] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 06:02:18 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:02:19.659262 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-c60102a1-128f-4510-80d7-842b0ff02e38 req-acaac49e-5dd1-4fd3-82b6-590c7bb256f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0749710-36f7-4f07-91de-d8bb6912e4cd", "tag": "98b02187-4655-44f8-a5e3-e0b8bb09400f"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:02:19.667645 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-c60102a1-128f-4510-80d7-842b0ff02e38 req-acaac49e-5dd1-4fd3-82b6-590c7bb256f4 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:02:19.668085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-c60102a1-128f-4510-80d7-842b0ff02e38 req-acaac49e-5dd1-4fd3-82b6-590c7bb256f4 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:02:19.679594 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-c60102a1-128f-4510-80d7-842b0ff02e38 req-acaac49e-5dd1-4fd3-82b6-590c7bb256f4 service nova] Creating event network-changed:98b02187-4655-44f8-a5e3-e0b8bb09400f for instance a0749710-36f7-4f07-91de-d8bb6912e4cd on hv-cinder-85044 Jul 21 06:02:19.684564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-c60102a1-128f-4510-80d7-842b0ff02e38 req-acaac49e-5dd1-4fd3-82b6-590c7bb256f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030215 Jul 21 06:02:19.685439 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 707/963] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:02:25.880829 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:02:25.881694 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:02:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:03:24.368515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:03:24.369728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=72 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:03:24.380305 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-42f4eb16-599f-49c5-904a-3672b9d1376d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:24.380902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-42f4eb16-599f-49c5-904a-3672b9d1376d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:24.393862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42f4eb16-599f-49c5-904a-3672b9d1376d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:24.394301 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42f4eb16-599f-49c5-904a-3672b9d1376d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:24.395121 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42f4eb16-599f-49c5-904a-3672b9d1376d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:24.395550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42f4eb16-599f-49c5-904a-3672b9d1376d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:24.421734 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-42f4eb16-599f-49c5-904a-3672b9d1376d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/ips" status: 200 len: 150 microversion: 2.1 time: 0.057160 Jul 21 06:03:24.422297 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 708/964] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 06:03:24 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/ips => generated 150 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:03:25.808633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e5d0af77-2c6d-48ac-9554-a29f80b6ef53 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "923faf9a-2ab2-4110-badf-f79d487b7ff9"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:03:25.809706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e5d0af77-2c6d-48ac-9554-a29f80b6ef53 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:25.817233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e5d0af77-2c6d-48ac-9554-a29f80b6ef53 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:25.817674 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e5d0af77-2c6d-48ac-9554-a29f80b6ef53 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:25.818433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e5d0af77-2c6d-48ac-9554-a29f80b6ef53 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:25.818863 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e5d0af77-2c6d-48ac-9554-a29f80b6ef53 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:26.082959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e5d0af77-2c6d-48ac-9554-a29f80b6ef53 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278190 Jul 21 06:03:26.083596 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 709/965] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 06:03:25 2022] POST /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:03:33.642215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b214100a-2e08-4a29-b60e-759df133118b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: .version_select at 0x7f509440dee0>, body: {"keypair": {"name": "tempest-keypair-224432075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwi0icfFWmaAksGRcOl0VsSh6Z6SBbKJNEzbxg7pGrj3RoEF96dEIa/OvT+SmhIFp6/eam6SqcKbkGpG3Hk66GCvOAusmDTDHL25gGr/fv/PyMUfYQw6p6MGqPeR09PAQ=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:03:33.657499 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-b214100a-2e08-4a29-b60e-759df133118b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:03:33.661520 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-b214100a-2e08-4a29-b60e-759df133118b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:03:33.685040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b214100a-2e08-4a29-b60e-759df133118b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047699 Jul 21 06:03:33.685628 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 710/966] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 06:03:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:03:34.955365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-661877732", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93367d36-116c-48ff-a4df-ca52ccc55a9c"}], "security_groups": [{"name": "tempest-securitygroup--966418721"}], "key_name": "tempest-keypair-224432075", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:03:35.067049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] validate_networks() for [('93367d36-116c-48ff-a4df-ca52ccc55a9c', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:03:35.449236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:03:35.449654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:03:35.450116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:03:35.450514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:03:35.450919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:03:35.460607 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:35.461047 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:35.461831 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:35.462250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:35.479167 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:03:35.483453 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:03:35.495126 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:03:35.497481 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:03:35.545847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-921a2def-a2f8-483d-bd41-540d47126906 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.595397 Jul 21 06:03:35.546524 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 711/967] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 06:03:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:03:35.558368 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-8c23773c-4d7e-4452-aee7-c5ec6ef60945 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:35.559296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-8c23773c-4d7e-4452-aee7-c5ec6ef60945 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:35.614224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-8c23773c-4d7e-4452-aee7-c5ec6ef60945 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:35.621515 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-8c23773c-4d7e-4452-aee7-c5ec6ef60945 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1240 microversion: 2.1 time: 0.068880 Jul 21 06:03:35.622079 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 712/968] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:35 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:03:36.639805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:36.640399 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:36.675473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:36.675904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:36.677205 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:36.677773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:36.752261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:36.760498 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-88fba417-db4c-4313-9c51-b5a7b8ddbe59 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1298 microversion: 2.1 time: 0.126230 Jul 21 06:03:36.761340 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 713/969] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:36 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:37.778112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:37.778728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:37.788393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:37.788673 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:37.789437 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:37.789867 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:37.997176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:38.005281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0b3abf14-ec7d-4c79-a104-a2a7d74f4775 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.231186 Jul 21 06:03:38.005951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 714/970] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:37 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:38.129265 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-67ed8edc-bfa3-4d91-b341-d30769afc75c req-81a5a7f4-b4e1-4be2-94b5-e298e17dfb69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599f4d20-6d6a-41e8-ab03-508b69c05f08", "tag": "784568c1-490a-4ff4-9082-e9945c3d0bd8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:03:38.141041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-67ed8edc-bfa3-4d91-b341-d30769afc75c req-81a5a7f4-b4e1-4be2-94b5-e298e17dfb69 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:38.141474 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-67ed8edc-bfa3-4d91-b341-d30769afc75c req-81a5a7f4-b4e1-4be2-94b5-e298e17dfb69 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:38.154698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-67ed8edc-bfa3-4d91-b341-d30769afc75c req-81a5a7f4-b4e1-4be2-94b5-e298e17dfb69 service nova] Creating event network-changed:784568c1-490a-4ff4-9082-e9945c3d0bd8 for instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 on hv-cinder-85044 Jul 21 06:03:38.161517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-67ed8edc-bfa3-4d91-b341-d30769afc75c req-81a5a7f4-b4e1-4be2-94b5-e298e17dfb69 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035901 Jul 21 06:03:38.162123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 715/971] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:03:39.028575 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:39.029787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:39.040896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:39.041638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:39.042886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:39.043654 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:39.182550 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:39.190423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5fe0e920-63c2-408c-986c-4e1f624ad715 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.169838 Jul 21 06:03:39.190998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 716/972] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:39 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:40.213752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:40.214773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:40.225725 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:40.226162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:40.226917 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:40.227372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:40.443855 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:40.452172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-886aa880-2fdf-4663-99ed-14657bc5d3eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.244894 Jul 21 06:03:40.452745 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 717/973] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:40 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:41.472823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:41.473964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:41.484685 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:41.485409 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:41.486647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:41.487418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:41.641219 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:41.649118 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bf3f294b-4f21-4b6d-bd27-548d05b24061 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.182667 Jul 21 06:03:41.649686 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 718/974] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:41 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:42.666612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:42.667242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:42.674284 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:42.674783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:42.675580 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:42.676016 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:42.813010 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:42.824088 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-569b2d44-ca6f-4972-8e59-35f48dc29172 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.160995 Jul 21 06:03:42.824857 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 719/975] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:42 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:03:43.849985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:43.850996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:43.858672 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:43.859152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:43.859920 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:43.860355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:43.991759 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:43.999433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6eee856f-fc27-4d74-b7b8-1956fc6bcc43 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.156147 Jul 21 06:03:44.000002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 720/976] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:43 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:45.021049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:45.022124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:45.030257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:45.030756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:45.032014 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:45.032511 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:45.164257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:45.172256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-46a761c9-d95e-4e1d-b7d1-771a501fa849 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.157724 Jul 21 06:03:45.172852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 721/977] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:45 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:45.604884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-2eaacabe-9131-4e0c-9cd7-06c0d8ccf035 req-f29703ee-7596-477a-8f63-066e65e44fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599f4d20-6d6a-41e8-ab03-508b69c05f08", "name": "network-vif-plugged", "status": "completed", "tag": "784568c1-490a-4ff4-9082-e9945c3d0bd8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:03:45.609844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:03:45.615989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2eaacabe-9131-4e0c-9cd7-06c0d8ccf035 req-f29703ee-7596-477a-8f63-066e65e44fa1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:45.616519 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-2eaacabe-9131-4e0c-9cd7-06c0d8ccf035 req-f29703ee-7596-477a-8f63-066e65e44fa1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:45.621768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=12 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:03:45.630454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-2eaacabe-9131-4e0c-9cd7-06c0d8ccf035 req-f29703ee-7596-477a-8f63-066e65e44fa1 service nova] Creating event network-vif-plugged:784568c1-490a-4ff4-9082-e9945c3d0bd8 for instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 on hv-cinder-85044 Jul 21 06:03:45.635574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-2eaacabe-9131-4e0c-9cd7-06c0d8ccf035 req-f29703ee-7596-477a-8f63-066e65e44fa1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034435 Jul 21 06:03:45.636161 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 722/978] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:03:46.190232 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:46.190954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:46.198020 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:46.198463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:46.199267 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:46.199695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:46.334612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:46.342518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b5b3dcbc-6d59-4416-9c56-77b1d3313e25 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.156769 Jul 21 06:03:46.343112 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 723/979] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:46 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:03:47.361296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:47.362188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:47.370038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:47.370472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:47.371266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:47.371810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:47.512533 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:47.524339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-be6c5dd6-5d20-4f2f-87e7-4f814fc9d777 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1365 microversion: 2.1 time: 0.167586 Jul 21 06:03:47.525159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 724/980] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:47 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:03:48.549852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:48.550553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:48.560840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:48.561390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:48.562387 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:48.562982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:48.710893 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:03:48.719306 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0f7671d0-fee3-4b15-aa69-fd66c62a723a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1556 microversion: 2.1 time: 0.174838 Jul 21 06:03:48.719890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 725/981] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:03:48 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:03:48.735752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b1a4d250-9041-48c0-ba08-817004eccc50 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:03:48.736223 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b1a4d250-9041-48c0-ba08-817004eccc50 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:03:48.743227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1a4d250-9041-48c0-ba08-817004eccc50 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:48.743669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1a4d250-9041-48c0-ba08-817004eccc50 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:48.744423 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1a4d250-9041-48c0-ba08-817004eccc50 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:48.744842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b1a4d250-9041-48c0-ba08-817004eccc50 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:48.836532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b1a4d250-9041-48c0-ba08-817004eccc50 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103725 Jul 21 06:03:48.837383 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 726/982] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 06:03:48 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:03:49.811128 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-84070a40-e3da-4e26-986c-55c5c77e8956 req-f6a54876-258b-4da4-8809-1a05002131a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "599f4d20-6d6a-41e8-ab03-508b69c05f08", "tag": "784568c1-490a-4ff4-9082-e9945c3d0bd8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:03:49.820068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-84070a40-e3da-4e26-986c-55c5c77e8956 req-f6a54876-258b-4da4-8809-1a05002131a7 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:03:49.820506 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-84070a40-e3da-4e26-986c-55c5c77e8956 req-f6a54876-258b-4da4-8809-1a05002131a7 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:03:49.833766 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-84070a40-e3da-4e26-986c-55c5c77e8956 req-f6a54876-258b-4da4-8809-1a05002131a7 service nova] Creating event network-changed:784568c1-490a-4ff4-9082-e9945c3d0bd8 for instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 on hv-cinder-85044 Jul 21 06:03:49.840033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-84070a40-e3da-4e26-986c-55c5c77e8956 req-f6a54876-258b-4da4-8809-1a05002131a7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Jul 21 06:03:49.840647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 727/983] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:05.253048 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:05:05.254564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:05:05.261516 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-686025f3-4fee-4fa8-83b5-30e9b5318848 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:05.262502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-686025f3-4fee-4fa8-83b5-30e9b5318848 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:05.273172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-686025f3-4fee-4fa8-83b5-30e9b5318848 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.273612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-686025f3-4fee-4fa8-83b5-30e9b5318848 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.274372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-686025f3-4fee-4fa8-83b5-30e9b5318848 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.274801 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-686025f3-4fee-4fa8-83b5-30e9b5318848 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.298930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-686025f3-4fee-4fa8-83b5-30e9b5318848 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08/ips" status: 200 len: 151 microversion: 2.1 time: 0.049787 Jul 21 06:05:05.299637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 728/984] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 06:05:05 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:05.309889 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "923faf9a-2ab2-4110-badf-f79d487b7ff9"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:05.310940 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:05.316891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.317326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.318077 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.318504 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.407848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Invalid volume: volume 923faf9a-2ab2-4110-badf-f79d487b7ff9 is already attached to instances: a0749710-36f7-4f07-91de-d8bb6912e4cd Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: POST /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08/os-volume_attachments HTTP/1.1 Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 74 Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:05:05.410478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {"volumeAttachment": {"volumeId": "923faf9a-2ab2-4110-badf-f79d487b7ff9"}} Jul 21 06:05:05.413025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Invalid volume: volume 923faf9a-2ab2-4110-badf-f79d487b7ff9 is already attached to instances: a0749710-36f7-4f07-91de-d8bb6912e4cd Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'server_id': '599f4d20-6d6a-41e8-ab03-508b69c05f08', 'body': {'volumeAttachment': {'volumeId': '923faf9a-2ab2-4110-badf-f79d487b7ff9'}}} Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 923faf9a-2ab2-4110-badf-f79d487b7ff9 is already attached to instances: a0749710-36f7-4f07-91de-d8bb6912e4cd Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:05.414187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 923faf9a-2ab2-4110-badf-f79d487b7ff9 is already attached to instances: a0749710-36f7-4f07-91de-d8bb6912e4cd Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:05.415903 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 923faf9a-2ab2-4110-badf-f79d487b7ff9 is already attached to instances: a0749710-36f7-4f07-91de-d8bb6912e4cd Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 400 to user: Invalid volume: volume 923faf9a-2ab2-4110-badf-f79d487b7ff9 is already attached to instances: a0749710-36f7-4f07-91de-d8bb6912e4cd {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5038fe22-4edb-4e9b-b818-287b64ba9a5f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106020 Jul 21 06:05:05.418041 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 729/985] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 06:05:05 2022] POST /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 06:05:05.423680 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:05.424493 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:05.431382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.431826 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.432612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.433038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.457496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:05:05.545464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c737a6b4-3d69-4cd7-a1d6-0896c67918bf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 204 len: 0 microversion: 2.1 time: 0.127361 Jul 21 06:05:05.546150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 730/986] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:05:05 2022] DELETE /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:05:05.554754 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:05.555597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:05.563142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.563567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.564322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:05.564745 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:05.710732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:05.718415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e136693d-6e40-40e6-b322-972e8b14f7ed tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1681 microversion: 2.1 time: 0.167992 Jul 21 06:05:05.718972 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 731/987] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:05 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:05:06.736314 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:06.736971 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:06.743898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:06.744335 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:06.745089 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:06.745514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:06.890773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:06.898464 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4c1b4d94-d759-414f-a8d1-386af0a31e91 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1681 microversion: 2.1 time: 0.166068 Jul 21 06:05:06.899001 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 732/988] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:06 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:07.916281 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:07.916898 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:07.923602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:07.924059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:07.925354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:07.925466 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:08.018553 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:08.026720 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e95a195f-3726-4d57-939e-0b283e1272b7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1614 microversion: 2.1 time: 0.114426 Jul 21 06:05:08.027591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 733/989] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:07 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1614 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:08.467256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-068c8f36-334a-46fa-8f99-5480d1f47388 req-aea6f987-35cd-4293-887e-a8dbdc56f8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "599f4d20-6d6a-41e8-ab03-508b69c05f08", "name": "network-vif-deleted", "tag": "784568c1-490a-4ff4-9082-e9945c3d0bd8"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:08.483403 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-068c8f36-334a-46fa-8f99-5480d1f47388 req-aea6f987-35cd-4293-887e-a8dbdc56f8d5 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:08.483765 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-068c8f36-334a-46fa-8f99-5480d1f47388 req-aea6f987-35cd-4293-887e-a8dbdc56f8d5 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:08.499604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-068c8f36-334a-46fa-8f99-5480d1f47388 req-aea6f987-35cd-4293-887e-a8dbdc56f8d5 service nova] Creating event network-vif-deleted:784568c1-490a-4ff4-9082-e9945c3d0bd8 for instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 on hv-cinder-85044 Jul 21 06:05:08.506528 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-068c8f36-334a-46fa-8f99-5480d1f47388 req-aea6f987-35cd-4293-887e-a8dbdc56f8d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042866 Jul 21 06:05:08.507610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 734/990] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:09.046730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:09.047452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:09.054227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:09.054671 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:09.055473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:09.055901 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:09.087171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:09.087618 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:09.088065 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lazy-loading 'fault' on Instance uuid 599f4d20-6d6a-41e8-ab03-508b69c05f08 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:05:09.129611 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:09.137450 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1bff41ba-fccf-41a1-bbe5-a73a4ee64148 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 200 len: 1330 microversion: 2.1 time: 0.095592 Jul 21 06:05:09.138012 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 735/991] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:09 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:05:10.159662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:10.160698 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:10.167878 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:10.168324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:10.169079 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:10.169514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:10.183035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 HTTP/1.1 Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:05:10.184668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:05:10.186347 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '599f4d20-6d6a-41e8-ab03-508b69c05f08'} Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:05:10.187320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:05:10.188845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:10.190298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:05:10.190298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0b1073d4-3ca7-47d9-86f2-443232408261 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 404 len: 111 microversion: 2.1 time: 0.033321 Jul 21 06:05:10.190298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 736/992] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:10 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:05:10.195897 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-71f45ad4-e34f-4633-90c7-f6ad6cdbc55a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '.version_select at 0x7f5090464310>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:10.220219 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-71f45ad4-e34f-4633-90c7-f6ad6cdbc55a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-224432075" status: 202 len: 0 microversion: 2.1 time: 0.028788 Jul 21 06:05:10.221076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 737/993] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jul 21 06:05:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-224432075 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:05:10.898656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:10.899170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:10.905124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:10.905595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:10.906739 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:10.907185 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:10.991193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lazy-loading 'services' on Instance uuid a0749710-36f7-4f07-91de-d8bb6912e4cd {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:05:11.067536 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7a4f80d6-da37-4b16-ae51-d02f54525b97 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments/923faf9a-2ab2-4110-badf-f79d487b7ff9" status: 202 len: 0 microversion: 2.1 time: 0.172540 Jul 21 06:05:11.068171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 738/994] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 06:05:10 2022] DELETE /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments/923faf9a-2ab2-4110-badf-f79d487b7ff9 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:05:11.077427 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-08eab393-d306-48a5-9ef1-57d37f96efa0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:11.078486 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-08eab393-d306-48a5-9ef1-57d37f96efa0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:11.085525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08eab393-d306-48a5-9ef1-57d37f96efa0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:11.085973 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08eab393-d306-48a5-9ef1-57d37f96efa0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:11.086783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08eab393-d306-48a5-9ef1-57d37f96efa0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:11.087333 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-08eab393-d306-48a5-9ef1-57d37f96efa0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:11.120199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-08eab393-d306-48a5-9ef1-57d37f96efa0 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047069 Jul 21 06:05:11.120768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 739/995] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:05:11 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:05:12.134018 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3990032c-c0ff-4e2a-8c29-8d2c4bef9241 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:12.134950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3990032c-c0ff-4e2a-8c29-8d2c4bef9241 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:12.141573 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3990032c-c0ff-4e2a-8c29-8d2c4bef9241 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:12.142015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3990032c-c0ff-4e2a-8c29-8d2c4bef9241 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:12.142774 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3990032c-c0ff-4e2a-8c29-8d2c4bef9241 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:12.143238 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3990032c-c0ff-4e2a-8c29-8d2c4bef9241 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:12.172558 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3990032c-c0ff-4e2a-8c29-8d2c4bef9241 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042499 Jul 21 06:05:12.173113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 740/996] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:05:12 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 21 06:05:12.234472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:12.235136 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:12.242748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:12.243230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:12.243992 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:12.244421 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:12.269758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:05:12.352075 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f03c3ca1-909f-4287-91ac-39bc6eabc1f3 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 204 len: 0 microversion: 2.1 time: 0.121727 Jul 21 06:05:12.352649 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 741/997] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:05:12 2022] DELETE /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:05:12.361149 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:12.361844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:12.367776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:12.368218 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:12.369633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:12.369633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:12.503773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:12.507366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:05:12.512420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-24daf4db-38aa-48c4-8631-2748b637d3ae tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1681 microversion: 2.1 time: 0.155270 Jul 21 06:05:12.513025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 742/998] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:12 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:05:13.534879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:13.536046 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:13.549069 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:13.549783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:13.550954 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:13.551840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:13.700627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:13.710900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-34cb3362-ad35-4443-9e63-ad9702b93d3b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1681 microversion: 2.1 time: 0.183062 Jul 21 06:05:13.711535 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 743/999] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:13 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:14.728714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:14.729442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:14.736548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:14.736987 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:14.737747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:14.738170 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:14.929955 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:14.938537 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5c243cc3-3d4c-4a3e-9b13-12220cc8a743 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 200 len: 1681 microversion: 2.1 time: 0.213804 Jul 21 06:05:14.939272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 744/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:14 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:05:15.316960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-c1771524-6ca0-466f-b66f-f0db23b8cc67 req-545fd99a-dc32-46e2-8567-287eed841164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0749710-36f7-4f07-91de-d8bb6912e4cd", "name": "network-vif-deleted", "tag": "98b02187-4655-44f8-a5e3-e0b8bb09400f"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:15.325823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-c1771524-6ca0-466f-b66f-f0db23b8cc67 req-545fd99a-dc32-46e2-8567-287eed841164 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:15.326296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-c1771524-6ca0-466f-b66f-f0db23b8cc67 req-545fd99a-dc32-46e2-8567-287eed841164 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:15.338993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-c1771524-6ca0-466f-b66f-f0db23b8cc67 req-545fd99a-dc32-46e2-8567-287eed841164 service nova] Creating event network-vif-deleted:98b02187-4655-44f8-a5e3-e0b8bb09400f for instance a0749710-36f7-4f07-91de-d8bb6912e4cd on hv-cinder-85044 Jul 21 06:05:15.344775 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-c1771524-6ca0-466f-b66f-f0db23b8cc67 req-545fd99a-dc32-46e2-8567-287eed841164 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031628 Jul 21 06:05:15.345395 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 745/1001] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:15.957659 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:15.958459 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:15.965013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:15.965454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:15.966211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:15.966640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:15.980352 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd HTTP/1.1 Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:05:15.982120 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:05:15.983828 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'a0749710-36f7-4f07-91de-d8bb6912e4cd'} Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:05:15.988105 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:05:15.989678 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:05:15.991147 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:05:15.991147 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-397f64f3-399a-4dc3-af7d-7e07315612a4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 404 len: 111 microversion: 2.1 time: 0.030797 Jul 21 06:05:15.991147 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 746/1002] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:15 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:05:15.991953 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bacda924-fba6-4583-a041-47375991125c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '.version_select at 0x7f50944041f0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:16.012338 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bacda924-fba6-4583-a041-47375991125c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306138087" status: 202 len: 0 microversion: 2.1 time: 0.023730 Jul 21 06:05:16.012823 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 747/1003] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jul 21 06:05:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306138087 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:05:16.667138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-23850784-9d37-4acb-b9b8-1843bf5e50bb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: .version_select at 0x7f5094444d30>, body: {"keypair": {"name": "tempest-keypair-1439719821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBee8O0F6egtQabLNzEsX2gl+tCMMcjf5U2QvRXQ2sbXpsNCjuIQyyNx6yF/R9mwF6nyMLylzNWbLT4d6i2QqoClDOE3nZ7tmuR5N6aZlU9+3fpnWVPoR7AbFs/7gdnGXA=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:16.682719 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-23850784-9d37-4acb-b9b8-1843bf5e50bb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:05:16.686843 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-23850784-9d37-4acb-b9b8-1843bf5e50bb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:05:16.711181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-23850784-9d37-4acb-b9b8-1843bf5e50bb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048335 Jul 21 06:05:16.711742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 748/1004] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 06:05:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:18.006892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-796122542", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93367d36-116c-48ff-a4df-ca52ccc55a9c"}], "security_groups": [{"name": "tempest-securitygroup--399108470"}], "key_name": "tempest-keypair-1439719821", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:18.112342 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] validate_networks() for [('93367d36-116c-48ff-a4df-ca52ccc55a9c', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:05:18.564779 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:05:18.565233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:05:18.565890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:05:18.566463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:05:18.567043 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:05:18.576496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:18.576941 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:18.577735 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:18.578166 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:18.595454 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:05:18.599548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:05:18.610887 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:05:18.613190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:05:18.673083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-4e8aa98d-80b0-4004-b2bd-9d4434ebb1c2 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.671175 Jul 21 06:05:18.673752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 749/1005] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 06:05:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:05:18.684010 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-146ee9bc-8d7b-4be2-b590-09cc9fc3f61a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:18.684812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-146ee9bc-8d7b-4be2-b590-09cc9fc3f61a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:18.741329 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-146ee9bc-8d7b-4be2-b590-09cc9fc3f61a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:18.748181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-146ee9bc-8d7b-4be2-b590-09cc9fc3f61a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1241 microversion: 2.1 time: 0.068164 Jul 21 06:05:18.748866 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 750/1006] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:18 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:19.765557 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:19.767045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:19.774346 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:19.774787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:19.775604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:19.776026 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:19.846896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:19.855191 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6e2bd4c9-9fbd-48dd-b889-f569d1364111 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1299 microversion: 2.1 time: 0.093496 Jul 21 06:05:19.855725 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 751/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:19 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:05:20.877760 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:20.878363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:20.885634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:20.886076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:20.886844 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:20.887372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:21.093113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:21.100680 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-09e94136-b73e-498b-b8fd-c5d15344c179 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.226881 Jul 21 06:05:21.101276 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 752/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:20 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:21.252677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-0d5e0c0c-ad55-4373-bd39-aa46b91006ed req-a567c54f-32ff-4625-b936-7d2b73d5a486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c1dde9-8b19-45f1-99d0-5a2a81e5cf68", "tag": "2fc24c94-bb47-4a45-a6e7-d9ff064b4c20"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:21.265143 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0d5e0c0c-ad55-4373-bd39-aa46b91006ed req-a567c54f-32ff-4625-b936-7d2b73d5a486 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:21.265782 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-0d5e0c0c-ad55-4373-bd39-aa46b91006ed req-a567c54f-32ff-4625-b936-7d2b73d5a486 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:21.280233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-0d5e0c0c-ad55-4373-bd39-aa46b91006ed req-a567c54f-32ff-4625-b936-7d2b73d5a486 service nova] Creating event network-changed:2fc24c94-bb47-4a45-a6e7-d9ff064b4c20 for instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 on hv-cinder-85044 Jul 21 06:05:21.286929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-0d5e0c0c-ad55-4373-bd39-aa46b91006ed req-a567c54f-32ff-4625-b936-7d2b73d5a486 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045568 Jul 21 06:05:21.287581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 753/1009] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:05:22.119116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:22.119773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:22.123365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:05:22.127296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:22.127737 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:22.128479 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:22.128902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:22.276460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:22.284772 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-fd9bdf50-77c3-4ab5-801f-e9e64cb0c566 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.169828 Jul 21 06:05:22.285264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 754/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:22 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:23.306488 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:23.307602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:23.318792 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:23.319583 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:23.320824 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:23.321536 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:23.462993 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:23.474257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bc726a0b-26f3-42f7-ace6-d8a55a7f8498 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.174376 Jul 21 06:05:23.474932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 755/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:23 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:24.493056 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:24.493799 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:24.501260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:24.501702 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:24.502452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:24.502851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:24.633721 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:24.641441 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0cbf7e5d-e62c-425b-81ee-ecd7002e486d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.152538 Jul 21 06:05:24.642005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 756/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:24 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:25.664478 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:25.665588 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:25.676252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:25.676995 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:25.678176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:25.678608 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:25.811214 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:25.818908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-dfb291ca-bd99-4dad-9bff-b21ec80ca0ee tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.161031 Jul 21 06:05:25.819501 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 757/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:25 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:26.838359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:26.839123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:26.846693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:26.847303 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:26.848224 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:26.848710 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:26.981790 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:26.989520 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-47b87af8-73e5-46bc-811c-781a994d2948 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.155863 Jul 21 06:05:26.990201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 758/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:26 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:28.006037 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:28.006733 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:28.013365 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:28.013813 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:28.014571 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:28.014994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:28.148002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:28.155573 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-472da3f2-5bd0-45e4-8a05-f68610810050 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.153620 Jul 21 06:05:28.156514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 759/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:28 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:28.160852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-58bee321-21aa-4ec5-b9de-d205dc382f7a req-2f700bc7-6ee9-44e9-8b4b-bac5f6128ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c1dde9-8b19-45f1-99d0-5a2a81e5cf68", "name": "network-vif-plugged", "status": "completed", "tag": "2fc24c94-bb47-4a45-a6e7-d9ff064b4c20"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:28.169184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-58bee321-21aa-4ec5-b9de-d205dc382f7a req-2f700bc7-6ee9-44e9-8b4b-bac5f6128ec6 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:28.169612 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-58bee321-21aa-4ec5-b9de-d205dc382f7a req-2f700bc7-6ee9-44e9-8b4b-bac5f6128ec6 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:28.180986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-58bee321-21aa-4ec5-b9de-d205dc382f7a req-2f700bc7-6ee9-44e9-8b4b-bac5f6128ec6 service nova] Creating event network-vif-plugged:2fc24c94-bb47-4a45-a6e7-d9ff064b4c20 for instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 on hv-cinder-85044 Jul 21 06:05:28.186391 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-58bee321-21aa-4ec5-b9de-d205dc382f7a req-2f700bc7-6ee9-44e9-8b4b-bac5f6128ec6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028759 Jul 21 06:05:28.186989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 760/1016] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:29.172858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:05:29.174166 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=12 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:05:29.180460 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:29.181154 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:29.188215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:29.188668 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:29.189428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:29.189848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:29.323497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:29.331641 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-58640171-7a07-4d1e-91db-24bd36ca3ee7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1366 microversion: 2.1 time: 0.160588 Jul 21 06:05:29.332172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 761/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:29 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:30.352722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:30.353542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:30.361517 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:30.362039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:30.362918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:30.363467 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:30.769889 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:05:30.777922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cdd24b61-6b29-47d7-815f-139fc7630951 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1557 microversion: 2.1 time: 0.431477 Jul 21 06:05:30.778493 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 762/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:05:30 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1557 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:05:30.794384 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5e8219c2-7130-4c7d-8785-c8d9d14a0618 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:05:30.794912 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5e8219c2-7130-4c7d-8785-c8d9d14a0618 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:05:30.801073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e8219c2-7130-4c7d-8785-c8d9d14a0618 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:30.801522 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e8219c2-7130-4c7d-8785-c8d9d14a0618 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:30.802287 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e8219c2-7130-4c7d-8785-c8d9d14a0618 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:30.802717 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5e8219c2-7130-4c7d-8785-c8d9d14a0618 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:30.880264 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5e8219c2-7130-4c7d-8785-c8d9d14a0618 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089317 Jul 21 06:05:30.880877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 763/1019] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 06:05:30 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:31.326322 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:05:31.326951 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:05:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:05:31.828711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-870b32b3-ab08-4d50-88dd-e889e2f01b81 req-9fcfbb0c-3d22-4800-8c09-a72f74cec89e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59c1dde9-8b19-45f1-99d0-5a2a81e5cf68", "tag": "2fc24c94-bb47-4a45-a6e7-d9ff064b4c20"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:05:31.837261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-870b32b3-ab08-4d50-88dd-e889e2f01b81 req-9fcfbb0c-3d22-4800-8c09-a72f74cec89e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:05:31.837695 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-870b32b3-ab08-4d50-88dd-e889e2f01b81 req-9fcfbb0c-3d22-4800-8c09-a72f74cec89e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:05:31.849248 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-870b32b3-ab08-4d50-88dd-e889e2f01b81 req-9fcfbb0c-3d22-4800-8c09-a72f74cec89e service nova] Creating event network-changed:2fc24c94-bb47-4a45-a6e7-d9ff064b4c20 for instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 on hv-cinder-85044 Jul 21 06:05:31.854364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-870b32b3-ab08-4d50-88dd-e889e2f01b81 req-9fcfbb0c-3d22-4800-8c09-a72f74cec89e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029892 Jul 21 06:05:31.854930 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 764/1020] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:05:45.894333 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:05:45.895230 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:05:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:06:38.224996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=20 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:06:38.226114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=88 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:06:38.231372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-587b221a-203a-470b-80d3-d07544e2e8ec tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:38.231947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-587b221a-203a-470b-80d3-d07544e2e8ec tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:38.238875 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-587b221a-203a-470b-80d3-d07544e2e8ec tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:38.239341 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-587b221a-203a-470b-80d3-d07544e2e8ec tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:38.240088 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-587b221a-203a-470b-80d3-d07544e2e8ec tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:38.240510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-587b221a-203a-470b-80d3-d07544e2e8ec tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:38.263382 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-587b221a-203a-470b-80d3-d07544e2e8ec tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/ips" status: 200 len: 150 microversion: 2.1 time: 0.042092 Jul 21 06:06:38.263935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 765/1021] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 06:06:38 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:06:39.614080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-638359b8-bc59-493a-970d-6c7ea52bb329 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dcf532b-f117-4177-8bc1-24683dcf0ebf"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:06:39.615203 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-638359b8-bc59-493a-970d-6c7ea52bb329 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:39.622461 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-638359b8-bc59-493a-970d-6c7ea52bb329 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:39.622908 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-638359b8-bc59-493a-970d-6c7ea52bb329 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:39.623706 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-638359b8-bc59-493a-970d-6c7ea52bb329 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:39.624141 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-638359b8-bc59-493a-970d-6c7ea52bb329 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:39.900922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-638359b8-bc59-493a-970d-6c7ea52bb329 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290723 Jul 21 06:06:39.901525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 766/1022] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 06:06:39 2022] POST /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:06:47.475643 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dcf532b-f117-4177-8bc1-24683dcf0ebf"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:06:47.477137 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:47.486994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:47.487683 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:47.488873 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:47.489496 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:47.574270 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Invalid volume: volume 4dcf532b-f117-4177-8bc1-24683dcf0ebf is already attached to instances: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: POST /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments HTTP/1.1 Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 74 Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:06:47.576052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {"volumeAttachment": {"volumeId": "4dcf532b-f117-4177-8bc1-24683dcf0ebf"}} Jul 21 06:06:47.577870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Invalid volume: volume 4dcf532b-f117-4177-8bc1-24683dcf0ebf is already attached to instances: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'server_id': '59c1dde9-8b19-45f1-99d0-5a2a81e5cf68', 'body': {'volumeAttachment': {'volumeId': '4dcf532b-f117-4177-8bc1-24683dcf0ebf'}}} Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4dcf532b-f117-4177-8bc1-24683dcf0ebf is already attached to instances: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:47.578820 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4dcf532b-f117-4177-8bc1-24683dcf0ebf is already attached to instances: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:06:47.580234 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4dcf532b-f117-4177-8bc1-24683dcf0ebf is already attached to instances: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 400 to user: Invalid volume: volume 4dcf532b-f117-4177-8bc1-24683dcf0ebf is already attached to instances: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9444a244-9bfd-4afa-b808-38819d024ed4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110097 Jul 21 06:06:47.581648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 767/1023] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 06:06:47 2022] POST /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 06:06:47.643256 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:47.643749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:47.650482 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:47.650982 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:47.651758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:47.652208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:47.747693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lazy-loading 'services' on Instance uuid 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:06:47.826393 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-be9b9c20-d514-46a9-9606-099c7284cef5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments/4dcf532b-f117-4177-8bc1-24683dcf0ebf" status: 202 len: 0 microversion: 2.1 time: 0.186952 Jul 21 06:06:47.826990 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 768/1024] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 06:06:47 2022] DELETE /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments/4dcf532b-f117-4177-8bc1-24683dcf0ebf => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 06:06:47.835495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ab1b4882-5ab3-4faa-9314-f0658cdb0abf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:47.836681 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ab1b4882-5ab3-4faa-9314-f0658cdb0abf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:47.842843 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab1b4882-5ab3-4faa-9314-f0658cdb0abf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:47.843322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab1b4882-5ab3-4faa-9314-f0658cdb0abf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:47.844074 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab1b4882-5ab3-4faa-9314-f0658cdb0abf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:47.844497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ab1b4882-5ab3-4faa-9314-f0658cdb0abf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:47.873617 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ab1b4882-5ab3-4faa-9314-f0658cdb0abf tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042026 Jul 21 06:06:47.874073 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 769/1025] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:06:47 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:06:48.889013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cd68d983-4414-4864-a5a1-01f201872928 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:48.890565 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cd68d983-4414-4864-a5a1-01f201872928 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:48.901476 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd68d983-4414-4864-a5a1-01f201872928 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:48.901918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd68d983-4414-4864-a5a1-01f201872928 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:48.902669 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd68d983-4414-4864-a5a1-01f201872928 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:48.903149 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cd68d983-4414-4864-a5a1-01f201872928 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:48.932448 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cd68d983-4414-4864-a5a1-01f201872928 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050398 Jul 21 06:06:48.932894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 770/1026] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:06:48 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:06:48.993357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:48.993900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:49.000810 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:49.001247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:49.001996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:49.002420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:49.027090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:06:49.114637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-738fc564-7bb9-42da-83c8-a4854f092697 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 204 len: 0 microversion: 2.1 time: 0.126543 Jul 21 06:06:49.115438 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 771/1027] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:06:48 2022] DELETE /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:06:49.124414 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:49.125098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:49.131076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:49.131547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:49.132292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:49.132714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:49.272076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:06:49.280067 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d03ee673-0766-4e76-a3c5-842756444f87 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1681 microversion: 2.1 time: 0.159691 Jul 21 06:06:49.280959 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 772/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:49 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:06:50.302211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:50.303260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:50.311797 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:50.312242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:50.313042 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:50.313507 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:50.473489 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:06:50.481542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e1045507-a85a-4b82-b9bf-19b818cecbef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1681 microversion: 2.1 time: 0.185949 Jul 21 06:06:50.482114 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 773/1029] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:50 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:06:51.499638 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:51.500331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:51.507159 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:51.507603 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:51.508350 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:51.508805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:51.731227 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:06:51.739035 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a9c6147f-45ff-485d-bc8a-1685afd3ac4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 200 len: 1681 microversion: 2.1 time: 0.243329 Jul 21 06:06:51.739616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 774/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:51 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:06:52.203581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-f33656c1-a022-4fed-82b6-9f140b49454a req-ad3a3434-5f78-47e0-8820-1da2afb13200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59c1dde9-8b19-45f1-99d0-5a2a81e5cf68", "name": "network-vif-deleted", "tag": "2fc24c94-bb47-4a45-a6e7-d9ff064b4c20"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:06:52.215219 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-f33656c1-a022-4fed-82b6-9f140b49454a req-ad3a3434-5f78-47e0-8820-1da2afb13200 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:52.215563 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-f33656c1-a022-4fed-82b6-9f140b49454a req-ad3a3434-5f78-47e0-8820-1da2afb13200 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:52.240647 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-f33656c1-a022-4fed-82b6-9f140b49454a req-ad3a3434-5f78-47e0-8820-1da2afb13200 service nova] Creating event network-vif-deleted:2fc24c94-bb47-4a45-a6e7-d9ff064b4c20 for instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 on hv-cinder-85044 Jul 21 06:06:52.251587 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-f33656c1-a022-4fed-82b6-9f140b49454a req-ad3a3434-5f78-47e0-8820-1da2afb13200 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114207 Jul 21 06:06:52.252568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 775/1031] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:06:52.757332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:52.758151 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:52.764929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:52.765400 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:52.766146 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:52.766567 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:52.779932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 HTTP/1.1 Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:06:52.781922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:06:52.783803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '59c1dde9-8b19-45f1-99d0-5a2a81e5cf68'} Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:06:52.784788 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:06:52.786452 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:06:52.788148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:06:52.788148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7ed426b7-4535-4e96-9ec8-14a546aa70b6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 404 len: 111 microversion: 2.1 time: 0.030261 Jul 21 06:06:52.788148 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 776/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:52 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 06:06:52.792843 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-26d0fa1a-5131-4d35-ac63-934d9d5ddc26 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '.version_select at 0x7f50943ae160>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:52.811358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-26d0fa1a-5131-4d35-ac63-934d9d5ddc26 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439719821" status: 202 len: 0 microversion: 2.1 time: 0.022204 Jul 21 06:06:52.811843 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 777/1033] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 06:06:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1439719821 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:06:53.693244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-29d6e4c0-df96-4ea7-91dc-edec510f060f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: .version_select at 0x7f509052c940>, body: {"keypair": {"name": "tempest-keypair-888801001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMspsjGVwnewSeG0e1OFyJ1IpCwmYb/2IKJhjIenm8bpGBW5Sv+kSskt/xP6l0KwL5rfFj3M3jcIj1fAxCQJkiYDCA15rJkyT8LUWOQjjy0iNd9HDL9hLPS70BM2a6jVKA=="}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:06:53.707925 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-29d6e4c0-df96-4ea7-91dc-edec510f060f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:06:53.711946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-29d6e4c0-df96-4ea7-91dc-edec510f060f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'key_pairs'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:06:53.737046 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-29d6e4c0-df96-4ea7-91dc-edec510f060f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048038 Jul 21 06:06:53.742977 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 778/1034] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 06:06:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:06:55.252201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-332561990", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93367d36-116c-48ff-a4df-ca52ccc55a9c"}], "security_groups": [{"name": "tempest-securitygroup--586897028"}], "key_name": "tempest-keypair-888801001", "user_data": "}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:06:55.357867 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] validate_networks() for [('93367d36-116c-48ff-a4df-ca52ccc55a9c', None, None, None, None, None)] {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:06:55.743595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:06:55.744295 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:06:55.744768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:06:55.745169 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:06:55.745573 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:06:55.755630 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:55.756068 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:55.756865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:55.757298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:55.774813 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:06:55.779725 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Getting quotas for user 631157435dd242be80eb9f9fbf89ae76 and project 1c87efe1b2b74d7d8749ae5e14bdd412. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:06:55.794814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:06:55.797332 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:06:55.848059 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-eeeea7ae-a5af-410e-a345-e021504b3e2d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.600749 Jul 21 06:06:55.848708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 779/1035] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 06:06:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:06:55.858633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3519b830-b60e-4454-9e0f-7160daee3c52 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:55.859349 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3519b830-b60e-4454-9e0f-7160daee3c52 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:55.912273 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3519b830-b60e-4454-9e0f-7160daee3c52 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:06:55.919636 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3519b830-b60e-4454-9e0f-7160daee3c52 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1240 microversion: 2.1 time: 0.064820 Jul 21 06:06:55.920176 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 780/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:55 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:06:56.937037 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:56.938442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:56.945247 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:56.945684 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:56.946465 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:56.946890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:57.033108 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:06:57.040722 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-062b77d9-92da-4578-97fc-49fc6eef695f tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1310 microversion: 2.1 time: 0.107714 Jul 21 06:06:57.041354 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 781/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:56 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1310 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:06:58.058153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:58.058859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:58.065544 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:58.065990 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:58.066760 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:58.067236 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:58.287548 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:06:58.300046 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-52ce9005-3a2a-429c-9a9f-c51cd91e66eb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1365 microversion: 2.1 time: 0.245860 Jul 21 06:06:58.302351 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 782/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:58 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:06:58.448770 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-a3f573ff-7b42-49cc-ac95-fe577696342f req-05e1fc1f-67a8-44cf-9538-b66a0dfbe614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36504334-59f9-4679-879f-258134cd0eab", "tag": "01ae72bc-3a14-4661-a8f4-6f6053147517"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:06:58.462802 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a3f573ff-7b42-49cc-ac95-fe577696342f req-05e1fc1f-67a8-44cf-9538-b66a0dfbe614 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:58.463270 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-a3f573ff-7b42-49cc-ac95-fe577696342f req-05e1fc1f-67a8-44cf-9538-b66a0dfbe614 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:58.469570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:06:58.477842 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-a3f573ff-7b42-49cc-ac95-fe577696342f req-05e1fc1f-67a8-44cf-9538-b66a0dfbe614 service nova] Creating event network-changed:01ae72bc-3a14-4661-a8f4-6f6053147517 for instance 36504334-59f9-4679-879f-258134cd0eab on hv-cinder-85044 Jul 21 06:06:58.483840 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-a3f573ff-7b42-49cc-ac95-fe577696342f req-05e1fc1f-67a8-44cf-9538-b66a0dfbe614 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041034 Jul 21 06:06:58.484581 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 783/1039] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:06:59.324627 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:06:59.325721 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:06:59.339906 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:59.340415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:59.341206 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:06:59.341632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:06:59.481776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:06:59.489732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-1320e846-c185-4786-921a-6682630b12ef tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1365 microversion: 2.1 time: 0.172364 Jul 21 06:06:59.490213 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 784/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:06:59 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:07:00.511983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:07:00.512946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:07:00.524023 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:00.524756 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:00.526002 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:00.526711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:00.669080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:07:00.676723 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-856db4ba-8ea1-4167-b0f1-f835893f0dcb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1365 microversion: 2.1 time: 0.171362 Jul 21 06:07:00.677306 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 785/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:07:00 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:07:01.740696 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:07:01.741306 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:07:01.747749 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:01.748186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:01.748937 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:01.749363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:01.887545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:07:01.895336 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-9079bfd3-ba45-4450-8ca7-7e81e993bfb7 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1365 microversion: 2.1 time: 0.205305 Jul 21 06:07:01.895900 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 786/1042] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:07:01 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:07:02.915543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:07:02.916405 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:07:02.923531 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:02.923975 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:02.924742 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:02.925173 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:03.065080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:07:03.072648 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f5328531-ce5d-4ffe-a02d-ab2d6ac0cc70 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1365 microversion: 2.1 time: 0.162143 Jul 21 06:07:03.073388 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 787/1043] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:07:02 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:07:04.094322 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:07:04.095472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:07:04.106214 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:04.106994 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:04.108289 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:04.109000 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:04.248233 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:07:04.259751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d81dbf2b-565d-4ea0-b801-fdc393169a71 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1365 microversion: 2.1 time: 0.172117 Jul 21 06:07:04.260310 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 788/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:07:04 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:07:04.611272 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-bb9a5983-ded8-4793-b662-83475ccee576 req-7a7276d0-b3d9-4fc7-828e-6587f6542a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36504334-59f9-4679-879f-258134cd0eab", "name": "network-vif-plugged", "status": "completed", "tag": "01ae72bc-3a14-4661-a8f4-6f6053147517"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:07:04.621856 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-bb9a5983-ded8-4793-b662-83475ccee576 req-7a7276d0-b3d9-4fc7-828e-6587f6542a27 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:04.622285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-bb9a5983-ded8-4793-b662-83475ccee576 req-7a7276d0-b3d9-4fc7-828e-6587f6542a27 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:04.633532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-bb9a5983-ded8-4793-b662-83475ccee576 req-7a7276d0-b3d9-4fc7-828e-6587f6542a27 service nova] Creating event network-vif-plugged:01ae72bc-3a14-4661-a8f4-6f6053147517 for instance 36504334-59f9-4679-879f-258134cd0eab on hv-cinder-85044 Jul 21 06:07:04.638479 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-bb9a5983-ded8-4793-b662-83475ccee576 req-7a7276d0-b3d9-4fc7-828e-6587f6542a27 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031715 Jul 21 06:07:04.639101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 789/1045] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:07:05.282800 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:07:05.284000 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:07:05.293355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:05.293803 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:05.294570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:05.295039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:05.428116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:07:05.437394 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-21c2d76b-6bc7-4627-8927-28f3d06d9fab tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1365 microversion: 2.1 time: 0.162962 Jul 21 06:07:05.437986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 790/1046] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:07:05 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:07:06.454242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:07:06.454847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:07:06.456899 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:07:06.457600 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=12 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:07:06.464386 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:06.464848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:06.465621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:06.466078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:06.602366 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:07:06.610138 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3b81bf16-04b6-4123-9449-94f7fd461f4a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1555 microversion: 2.1 time: 0.159981 Jul 21 06:07:06.610708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 791/1047] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:07:06 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:07:06.626299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3017d28a-2991-49ea-afd3-647f0be1ebba tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:07:06.626728 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3017d28a-2991-49ea-afd3-647f0be1ebba tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:07:06.632529 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3017d28a-2991-49ea-afd3-647f0be1ebba tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:06.632970 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3017d28a-2991-49ea-afd3-647f0be1ebba tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:06.633727 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3017d28a-2991-49ea-afd3-647f0be1ebba tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:06.634153 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3017d28a-2991-49ea-afd3-647f0be1ebba tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:06.712245 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3017d28a-2991-49ea-afd3-647f0be1ebba tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089163 Jul 21 06:07:06.713085 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 792/1048] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 06:07:06 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:07:07.920208 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-e4169998-0635-4ac1-b175-e700c07db981 req-63a9dbea-7a43-4c66-9b0e-afac9aa15a0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36504334-59f9-4679-879f-258134cd0eab", "tag": "01ae72bc-3a14-4661-a8f4-6f6053147517"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:07:07.929356 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e4169998-0635-4ac1-b175-e700c07db981 req-63a9dbea-7a43-4c66-9b0e-afac9aa15a0e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:07:07.929865 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e4169998-0635-4ac1-b175-e700c07db981 req-63a9dbea-7a43-4c66-9b0e-afac9aa15a0e service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:07:07.940879 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-e4169998-0635-4ac1-b175-e700c07db981 req-63a9dbea-7a43-4c66-9b0e-afac9aa15a0e service nova] Creating event network-changed:01ae72bc-3a14-4661-a8f4-6f6053147517 for instance 36504334-59f9-4679-879f-258134cd0eab on hv-cinder-85044 Jul 21 06:07:07.945910 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-e4169998-0635-4ac1-b175-e700c07db981 req-63a9dbea-7a43-4c66-9b0e-afac9aa15a0e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030111 Jul 21 06:07:07.946560 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 793/1049] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:08:12.668874 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:08:12.669623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=50 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:08:12.673750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3597e1f2-86eb-4cde-9859-727dce603ddd tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:12.674326 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-3597e1f2-86eb-4cde-9859-727dce603ddd tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:12.681902 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3597e1f2-86eb-4cde-9859-727dce603ddd tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:12.682472 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3597e1f2-86eb-4cde-9859-727dce603ddd tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:12.683320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3597e1f2-86eb-4cde-9859-727dce603ddd tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:12.683750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-3597e1f2-86eb-4cde-9859-727dce603ddd tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:12.707614 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3597e1f2-86eb-4cde-9859-727dce603ddd tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/ips" status: 200 len: 150 microversion: 2.1 time: 0.040782 Jul 21 06:08:12.708175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 794/1050] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 06:08:12 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:08:14.056449 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-435d5f96-7908-49b8-a2e6-adaef443275a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a20b45c9-8c51-41af-8f77-b814fdc2ebb4"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:08:14.057532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-435d5f96-7908-49b8-a2e6-adaef443275a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:14.064396 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-435d5f96-7908-49b8-a2e6-adaef443275a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:14.064834 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-435d5f96-7908-49b8-a2e6-adaef443275a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:14.065583 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-435d5f96-7908-49b8-a2e6-adaef443275a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:14.066053 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-435d5f96-7908-49b8-a2e6-adaef443275a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:14.345552 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-435d5f96-7908-49b8-a2e6-adaef443275a tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "POST /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293034 Jul 21 06:08:14.346142 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 795/1051] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 06:08:14 2022] POST /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:08:21.993633 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:21.994268 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:22.000845 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:22.001288 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:22.002040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:22.002494 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:22.083416 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.objects.instance [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lazy-loading 'services' on Instance uuid 36504334-59f9-4679-879f-258134cd0eab {{(pid=124328) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 06:08:22.159574 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f7f75081-83c5-4d5b-b5bb-bd377666f219 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments/a20b45c9-8c51-41af-8f77-b814fdc2ebb4" status: 202 len: 0 microversion: 2.1 time: 0.170551 Jul 21 06:08:22.160193 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 796/1052] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 06:08:21 2022] DELETE /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments/a20b45c9-8c51-41af-8f77-b814fdc2ebb4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:08:22.168805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-46ca5bd4-26bf-4024-955b-eb25b5f952dc tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:22.169811 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-46ca5bd4-26bf-4024-955b-eb25b5f952dc tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:22.176091 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46ca5bd4-26bf-4024-955b-eb25b5f952dc tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:22.176510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46ca5bd4-26bf-4024-955b-eb25b5f952dc tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:22.177298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46ca5bd4-26bf-4024-955b-eb25b5f952dc tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:22.177814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-46ca5bd4-26bf-4024-955b-eb25b5f952dc tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:22.208022 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-46ca5bd4-26bf-4024-955b-eb25b5f952dc tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043277 Jul 21 06:08:22.208576 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 797/1053] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:08:22 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:08:23.219458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-42aad29e-e4a0-455f-8b36-ef984477ae3c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:23.220383 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-42aad29e-e4a0-455f-8b36-ef984477ae3c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:23.227526 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42aad29e-e4a0-455f-8b36-ef984477ae3c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:23.227964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42aad29e-e4a0-455f-8b36-ef984477ae3c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:23.228714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42aad29e-e4a0-455f-8b36-ef984477ae3c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:23.229134 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-42aad29e-e4a0-455f-8b36-ef984477ae3c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:23.258116 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-42aad29e-e4a0-455f-8b36-ef984477ae3c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042741 Jul 21 06:08:23.258653 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 798/1054] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 06:08:23 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 06:08:23.323859 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:23.324359 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:23.330564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:23.331031 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:23.331806 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:23.332274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:23.356674 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:08:23.437505 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-00eacdc3-a087-46d3-b79a-a9a6534d65d4 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 204 len: 0 microversion: 2.1 time: 0.116956 Jul 21 06:08:23.438094 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 799/1055] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:08:23 2022] DELETE /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 06:08:23.446724 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:23.447458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:23.453411 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:23.453860 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:23.454616 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:23.455083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:23.589851 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:08:23.597808 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-cc5bf745-b5ce-460f-b585-686b020b8964 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1680 microversion: 2.1 time: 0.155203 Jul 21 06:08:23.598375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 800/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:23 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:08:24.619407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:24.620372 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:24.630418 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:24.630861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:24.631652 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:24.632078 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:24.773065 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:08:24.784375 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2e4d31fb-f4f5-4941-8f18-1d39ac4a289c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1680 microversion: 2.1 time: 0.171396 Jul 21 06:08:24.784985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 801/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:24 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:08:25.802098 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:25.802707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:25.816358 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:25.816814 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:25.817662 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:25.818124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:25.884555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '631157435dd242be80eb9f9fbf89ae76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c87efe1b2b74d7d8749ae5e14bdd412', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:08:25.892479 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-138dc411-3c46-4a32-937a-fc1eba1ff5cb tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 200 len: 1613 microversion: 2.1 time: 0.094533 Jul 21 06:08:25.899891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 802/1058] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:25 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:08:26.116614 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-274b4dbc-c229-4c0b-b67a-7cbaa28b00d8 req-09ca1a45-1984-4e7e-ad6f-903a13ca5d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36504334-59f9-4679-879f-258134cd0eab", "name": "network-vif-deleted", "tag": "01ae72bc-3a14-4661-a8f4-6f6053147517"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:08:26.125769 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-274b4dbc-c229-4c0b-b67a-7cbaa28b00d8 req-09ca1a45-1984-4e7e-ad6f-903a13ca5d21 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:26.126274 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-274b4dbc-c229-4c0b-b67a-7cbaa28b00d8 req-09ca1a45-1984-4e7e-ad6f-903a13ca5d21 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:26.137904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-274b4dbc-c229-4c0b-b67a-7cbaa28b00d8 req-09ca1a45-1984-4e7e-ad6f-903a13ca5d21 service nova] Creating event network-vif-deleted:01ae72bc-3a14-4661-a8f4-6f6053147517 for instance 36504334-59f9-4679-879f-258134cd0eab on hv-cinder-85044 Jul 21 06:08:26.143229 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-274b4dbc-c229-4c0b-b67a-7cbaa28b00d8 req-09ca1a45-1984-4e7e-ad6f-903a13ca5d21 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030894 Jul 21 06:08:26.147812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 803/1059] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:08:26.911568 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:26.912259 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:26.919415 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:26.919776 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:26.920547 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:26.920974 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:26.935152 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab HTTP/1.1 Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:26.936848 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:26.938634 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '36504334-59f9-4679-879f-258134cd0eab'} Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:26.939629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:26.941156 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:26.943624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:26.943624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a8858cf1-7376-457a-9b11-c99e5faa066e tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 404 len: 111 microversion: 2.1 time: 0.031677 Jul 21 06:08:26.943624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 804/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:26 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:26.947513 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-03fe705d-40f1-4837-8ff9-f36e82b0b13c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '.version_select at 0x7f5090553820>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:26.968017 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-03fe705d-40f1-4837-8ff9-f36e82b0b13c tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-888801001" status: 202 len: 0 microversion: 2.1 time: 0.024141 Jul 21 06:08:26.968680 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 805/1061] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jul 21 06:08:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-888801001 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 06:08:28.739947 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:28.740591 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:28.747688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:28.748058 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:28.748837 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:28.749260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:28.762655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab HTTP/1.1 Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:28.764275 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.766125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '36504334-59f9-4679-879f-258134cd0eab'} Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:28.767221 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.768964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.770655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:28.770655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ba0e2f45-630c-4b27-b2f9-b4b8ad93e776 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 404 len: 111 microversion: 2.1 time: 0.030044 Jul 21 06:08:28.770655 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 806/1062] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:08:28 2022] DELETE /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:28.773700 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:28.774435 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 36504334-59f9-4679-879f-258134cd0eab] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:28.780748 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:28.781190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:28.781932 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:28.782331 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:28.795604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab HTTP/1.1 Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:28.797115 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.798884 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '36504334-59f9-4679-879f-258134cd0eab'} Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:28.799922 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. Jul 21 06:08:28.801530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:28.803182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 36504334-59f9-4679-879f-258134cd0eab could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:28.803182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-63987a5b-86f6-4b0a-a099-e98edc94a3e5 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab" status: 404 len: 111 microversion: 2.1 time: 0.028390 Jul 21 06:08:28.803182 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 807/1063] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:28 2022] GET /compute/v2.1/servers/36504334-59f9-4679-879f-258134cd0eab => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:29.958732 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:29.959378 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:29.965911 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:29.966355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:29.967162 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:29.967595 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:29.983005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 HTTP/1.1 Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:29.984546 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:29.986252 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '59c1dde9-8b19-45f1-99d0-5a2a81e5cf68'} Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:29.987294 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:29.988996 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:29.990711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:29.990711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-912edb2c-891a-40e0-b135-4baabf5ff12d tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 404 len: 111 microversion: 2.1 time: 0.031065 Jul 21 06:08:29.990711 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 808/1064] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:08:29 2022] DELETE /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:29.993701 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:29.994299 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:30.000081 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:30.000519 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:30.001261 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:30.001693 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:30.015398 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 HTTP/1.1 Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:30.016888 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:30.018609 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '59c1dde9-8b19-45f1-99d0-5a2a81e5cf68'} Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:30.019632 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. Jul 21 06:08:30.021266 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.022921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:30.022921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b97aebc5-2f9f-429c-ba3d-2708209baf35 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68" status: 404 len: 111 microversion: 2.1 time: 0.027973 Jul 21 06:08:30.022921 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 809/1065] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:29 2022] GET /compute/v2.1/servers/59c1dde9-8b19-45f1-99d0-5a2a81e5cf68 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 06:08:30.025783 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:30.026257 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:30.032292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:30.032737 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:30.033473 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:30.033958 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:30.046822 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 HTTP/1.1 Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:30.048324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.050080 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '599f4d20-6d6a-41e8-ab03-508b69c05f08'} Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:30.050950 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.052443 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.054083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:30.054083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b3c27db4-f33e-4a76-b4c8-43616fad5b20 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 404 len: 111 microversion: 2.1 time: 0.027308 Jul 21 06:08:30.054083 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 810/1066] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:08:30 2022] DELETE /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:30.057325 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:30.057919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: 599f4d20-6d6a-41e8-ab03-508b69c05f08] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:30.063570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:30.064009 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:30.064750 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:30.065186 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:30.078164 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 HTTP/1.1 Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:30.079661 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.081521 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '599f4d20-6d6a-41e8-ab03-508b69c05f08'} Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:30.082514 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. Jul 21 06:08:30.084458 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:30.085951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance 599f4d20-6d6a-41e8-ab03-508b69c05f08 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:30.085951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-15270791-a0d4-4093-842b-2ae3e32b4ca6 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08" status: 404 len: 111 microversion: 2.1 time: 0.027034 Jul 21 06:08:30.085951 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 811/1067] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:30 2022] GET /compute/v2.1/servers/599f4d20-6d6a-41e8-ab03-508b69c05f08 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:31.236298 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:31.236918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:31.243412 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:31.243847 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:31.244602 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:31.245021 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:31.258243 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: DELETE /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd HTTP/1.1 Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:31.259858 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.261637 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'a0749710-36f7-4f07-91de-d8bb6912e4cd'} Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:31.262738 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.264271 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.265960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:31.265960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a7d6e820-e14b-4232-bdb3-d47d2f66551b tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 404 len: 111 microversion: 2.1 time: 0.028768 Jul 21 06:08:31.265960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 812/1068] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:08:31 2022] DELETE /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:31.268833 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:31.269428 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] [instance: a0749710-36f7-4f07-91de-d8bb6912e4cd] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:08:31.275049 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:31.275487 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:31.276230 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:08:31.276651 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:08:31.289846 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] HTTP exception thrown: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Request method failure captured: Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd HTTP/1.1 Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2OvYhsf4kmklvK2s5o7CxkJN0u4XtRVloTOEDw8nUyixoA62YBS5pwEQlESy8grdiZS8cgV-n9cgK04cekrwgIiQYJqo3GZETL21MWVtceBOwzeK3z9FRzpQdFD48VRA-P1DSYOa14b-jR-FFJkwKvdMgFZuGmKk4EzX-ZjlW9sfsjs Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:08:31.291370 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_1c87efe1b2b74d7d8749ae5e14bdd412", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/1c87efe1b2b74d7d8749ae5e14bdd412"}]}] Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 1c87efe1b2b74d7d8749ae5e14bdd412 Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-243449613 Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 631157435dd242be80eb9f9fbf89ae76 Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-AttachVolumeNegativeTest-243449613-project Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.293125 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': 'a0749710-36f7-4f07-91de-d8bb6912e4cd'} Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:08:31.294330 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. Jul 21 06:08:31.296025 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:08:31.297677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] Returning 404 to user: Instance a0749710-36f7-4f07-91de-d8bb6912e4cd could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:08:31.297677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-50217098-cd39-4a2d-a92f-f5ad061f9e89 tempest-AttachVolumeNegativeTest-243449613 tempest-AttachVolumeNegativeTest-243449613-project] 10.222.0.44 "GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd" status: 404 len: 111 microversion: 2.1 time: 0.027218 Jul 21 06:08:31.297677 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 813/1069] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:08:31 2022] GET /compute/v2.1/servers/a0749710-36f7-4f07-91de-d8bb6912e4cd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:08:37.099285 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-630abdb2-934b-4e08-89e9-9355f789fd53 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f50902f24c0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:37.155475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-630abdb2-934b-4e08-89e9-9355f789fd53 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/755a2a2f-6aeb-4c5d-b451-6764ae93a0cb" status: 200 len: 351 microversion: 2.1 time: 0.059361 Jul 21 06:08:37.156158 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 814/1070] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 06:08:37 2022] GET /compute/v2.1/os-volumes/755a2a2f-6aeb-4c5d-b451-6764ae93a0cb => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:08:38.505665 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-3910e523-3f69-4360-8a0e-4934fd5fbbac tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f5094408dc0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:38.558694 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-3910e523-3f69-4360-8a0e-4934fd5fbbac tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e70b6c71-c97d-439d-a897-8a44be9f9eec" status: 200 len: 351 microversion: 2.1 time: 0.057170 Jul 21 06:08:38.559312 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 815/1071] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 06:08:38 2022] GET /compute/v2.1/os-volumes/e70b6c71-c97d-439d-a897-8a44be9f9eec => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:08:39.948586 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-0a7af9e0-7f05-434c-ade1-c9565273fe8e tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f5090553820>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:39.996082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-0a7af9e0-7f05-434c-ade1-c9565273fe8e tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/c93f706d-33f9-4b5e-8064-806dc8972ef0" status: 200 len: 350 microversion: 2.1 time: 0.051693 Jul 21 06:08:39.996631 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 816/1072] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 06:08:39 2022] GET /compute/v2.1/os-volumes/c93f706d-33f9-4b5e-8064-806dc8972ef0 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:08:40.007470 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-14b40449-96e4-4918-9a51-30bfeda94292 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f50943a8820>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.096534 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-14b40449-96e4-4918-9a51-30bfeda94292 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092124 Jul 21 06:08:40.097390 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 817/1073] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:08:40.112301 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-d6ea51f4-04ca-4db3-9eec-7d4b7686953a tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f5090553820>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.313172 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-d6ea51f4-04ca-4db3-9eec-7d4b7686953a tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.204298 Jul 21 06:08:40.313744 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 818/1074] 10.222.0.44 () {58 vars in 1148 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 06:08:40.325566 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-751f9052-d29f-4564-be91-b9f747c04d16 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f5090582820>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.412184 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-751f9052-d29f-4564-be91-b9f747c04d16 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089803 Jul 21 06:08:40.412751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 819/1075] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:08:40.428746 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c677bf60-736e-472c-ac17-9a57e017ea21 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f50902f24c0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.512319 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c677bf60-736e-472c-ac17-9a57e017ea21 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089093 Jul 21 06:08:40.512890 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 820/1076] 10.222.0.44 () {58 vars in 1166 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:08:40.527040 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-bc2402fb-b491-43ec-9824-8ef7766db862 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f509440db80>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.613714 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-bc2402fb-b491-43ec-9824-8ef7766db862 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089900 Jul 21 06:08:40.614502 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 821/1077] 10.222.0.44 () {58 vars in 1169 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:08:40.629039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-01d52fb3-ece0-4a8b-9ebe-9c0d14bc1154 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f5094404790>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.710410 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-01d52fb3-ece0-4a8b-9ebe-9c0d14bc1154 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084786 Jul 21 06:08:40.710983 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 822/1078] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:08:40.722053 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-c17aadce-a521-44a2-b8ce-efc688160828 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f50943d55e0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.805194 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-c17aadce-a521-44a2-b8ce-efc688160828 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086567 Jul 21 06:08:40.805764 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 823/1079] 10.222.0.44 () {58 vars in 1187 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:08:40.817667 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a8e5cc93-2911-4eb8-b04b-53545c97a5b1 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] Calling method '.version_select at 0x7f50943a8dc0>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:08:40.903747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a8e5cc93-2911-4eb8-b04b-53545c97a5b1 tempest-VolumesTestJSON-183426148 tempest-VolumesTestJSON-183426148-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.089466 Jul 21 06:08:40.904404 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 824/1080] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jul 21 06:08:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:08:51.336497 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:08:51.337235 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:09:05.906831 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:09:05.907833 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:09:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:09:39.381005 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:09:39.381772 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:09:39.386357 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-430689791", "imageRef": "316bf9ef-0f34-41e2-8519-4da7b554c3c1", "flavorRef": "452"}} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:09:39.438320 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.network.neutron [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] validate_networks() for None {{(pid=124328) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 06:09:39.713466 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Flavor limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 06:09:39.713892 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Image limits 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 06:09:39.714363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Flavor pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 06:09:39.714763 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Image pref 0:0:0 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 06:09:39.715211 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.virt.hardware [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124328) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 06:09:39.724812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:39.725245 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:39.726044 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:39.726475 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:39.743854 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Getting quotas for project 412742fe621f4e63acb5891ae57a10d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 06:09:39.748057 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.quota [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Getting quotas for user 3d7bbfba930843cd9782c4bf4931c3b1 and project 412742fe621f4e63acb5891ae57a10d0. Resources: {'cores', 'instances', 'ram'} {{(pid=124328) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 06:09:39.760183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Going to run 1 instances... {{(pid=124328) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 06:09:39.762543 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='316bf9ef-0f34-41e2-8519-4da7b554c3c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124328) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 06:09:39.816752 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-2b7ba5e6-43d3-4672-9fe7-e8f2fbbd97b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.437122 Jul 21 06:09:39.817621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 825/1081] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 06:09:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 06:09:39.827292 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-77d05168-f176-4b17-9de6-390b07e4dcbd tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:39.827919 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-77d05168-f176-4b17-9de6-390b07e4dcbd tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:39.884363 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-77d05168-f176-4b17-9de6-390b07e4dcbd tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:39.891402 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-77d05168-f176-4b17-9de6-390b07e4dcbd tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1214 microversion: 2.1 time: 0.067780 Jul 21 06:09:39.891957 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 826/1082] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:39 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:40.909250 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:40.909916 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:40.917110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:40.917556 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:40.918319 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:40.918751 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:40.994935 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:41.002688 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-acc0c2a6-aabd-4daa-b1eb-27301a161714 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1274 microversion: 2.1 time: 0.097812 Jul 21 06:09:41.003495 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 827/1083] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:40 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:42.020449 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:42.021111 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:42.027960 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:42.028407 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:42.029175 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:42.029610 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:42.230708 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:42.243171 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a1cebcaa-a821-4a6b-bbf7-9200d3f423cc tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.226555 Jul 21 06:09:42.244597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 828/1084] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:42 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:42.473215 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-e8ec4d3a-671f-45c3-b4bf-853b38e20522 req-6f0f7f0d-1ba3-4703-ba57-f732f57bc6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215f0ad3-e8a5-461d-adf8-6f61138cf4d3", "tag": "c3b20aa5-642c-4aaa-8149-27f7d0cb9d82"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:09:42.482918 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e8ec4d3a-671f-45c3-b4bf-853b38e20522 req-6f0f7f0d-1ba3-4703-ba57-f732f57bc6b1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:42.484013 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-e8ec4d3a-671f-45c3-b4bf-853b38e20522 req-6f0f7f0d-1ba3-4703-ba57-f732f57bc6b1 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:42.495784 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-e8ec4d3a-671f-45c3-b4bf-853b38e20522 req-6f0f7f0d-1ba3-4703-ba57-f732f57bc6b1 service nova] Creating event network-changed:c3b20aa5-642c-4aaa-8149-27f7d0cb9d82 for instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 on hv-cinder-85044 Jul 21 06:09:42.510640 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-e8ec4d3a-671f-45c3-b4bf-853b38e20522 req-6f0f7f0d-1ba3-4703-ba57-f732f57bc6b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032863 Jul 21 06:09:42.511355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 829/1085] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:09:43.268794 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:43.269894 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:43.281076 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:43.281510 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:43.282278 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:43.282707 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:43.415862 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:43.423809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-060bebad-f5ac-4728-a925-f343f4ea4f66 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.162227 Jul 21 06:09:43.424433 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 830/1086] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:43 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:44.449868 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:44.451003 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:44.462110 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:44.462896 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:44.464217 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:44.464946 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:44.600008 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:44.611657 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-6f2a9c5d-bbff-455a-98da-25b227a8de98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.168073 Jul 21 06:09:44.612420 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 831/1087] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:44 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:45.637731 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:45.638985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:45.647629 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:45.648045 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:45.648805 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:45.649242 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:45.785656 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:45.793383 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-5fc4ec11-9c56-4f8c-8b1f-9c1959c2b2a2 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.162343 Jul 21 06:09:45.793945 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 832/1088] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:45 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:46.814891 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:46.816070 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:46.824545 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:46.825033 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:46.825985 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:46.826518 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:46.963597 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:46.971542 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-b6cae226-88d5-4b4d-a754-77d752de5597 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.163358 Jul 21 06:09:46.972199 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 833/1089] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:46 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:47.989147 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:47.989852 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:47.996555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:47.996998 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:47.997758 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:47.998181 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:48.129463 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:48.137011 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-f3cf06ae-b57f-4c0f-b3f8-8b8e8fbb7957 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.151971 Jul 21 06:09:48.137578 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 834/1090] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:47 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:49.155773 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:49.156477 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:49.163569 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:49.164015 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:49.164772 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:49.165210 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:49.295201 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:49.304730 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-e780bc1d-cd29-4321-a2f7-9a2312f51c8a tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.153309 Jul 21 06:09:49.305296 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 835/1091] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:49 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:49.624052 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-ff8f81db-0731-4899-8d67-cde98841ecdf req-86766b90-8539-4422-91bd-e4903b5ee159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215f0ad3-e8a5-461d-adf8-6f61138cf4d3", "name": "network-vif-plugged", "status": "completed", "tag": "c3b20aa5-642c-4aaa-8149-27f7d0cb9d82"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:09:49.632341 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-ff8f81db-0731-4899-8d67-cde98841ecdf req-86766b90-8539-4422-91bd-e4903b5ee159 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:49.632768 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-ff8f81db-0731-4899-8d67-cde98841ecdf req-86766b90-8539-4422-91bd-e4903b5ee159 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:49.646604 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-ff8f81db-0731-4899-8d67-cde98841ecdf req-86766b90-8539-4422-91bd-e4903b5ee159 service nova] Creating event network-vif-plugged:c3b20aa5-642c-4aaa-8149-27f7d0cb9d82 for instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 on hv-cinder-85044 Jul 21 06:09:49.651886 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-ff8f81db-0731-4899-8d67-cde98841ecdf req-86766b90-8539-4422-91bd-e4903b5ee159 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147159 Jul 21 06:09:49.652555 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 836/1092] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:09:50.322978 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=2 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:09:50.323836 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell0:SELECT=8 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:09:50.328355 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:50.329046 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:50.336488 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:50.336929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:50.337679 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:50.338101 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:50.480964 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:50.492385 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-60356d5b-bb94-4926-ad13-f5d2d7c159f5 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1314 microversion: 2.1 time: 0.170380 Jul 21 06:09:50.492948 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 837/1093] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:50 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:51.517861 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:51.518986 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:51.530183 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:51.530917 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:51.532222 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:51.532984 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:51.666904 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:51.674532 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-ec5e91f4-81b0-46dc-a972-c6d81c05d6b1 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1464 microversion: 2.1 time: 0.163272 Jul 21 06:09:51.675113 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 838/1094] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:51 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1464 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:51.714039 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:51.714525 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:51.720753 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:51.721188 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:51.721923 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:51.722339 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:51.746809 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Going to try to terminate instance {{(pid=124328) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 06:09:51.827343 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-219cc0aa-27e7-421a-870d-3a9e3f9500ba tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "DELETE /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 204 len: 0 microversion: 2.1 time: 0.116572 Jul 21 06:09:51.827876 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 839/1095] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 06:09:51 2022] DELETE /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 06:09:51.836564 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:51.837260 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:51.843311 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:51.843757 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:51.844503 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:51.844929 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:51.980180 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:51.987945 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-776ed827-4eca-44c3-9d59-aa873a2b4e05 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1470 microversion: 2.1 time: 0.155508 Jul 21 06:09:51.988479 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 840/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:51 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 06:09:53.008570 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:53.009324 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:53.016681 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:53.017123 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:53.017877 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:53.018308 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:53.184863 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:53.196497 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-a7c99739-4e3b-4bbd-a98a-a6e276341030 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1470 microversion: 2.1 time: 0.192533 Jul 21 06:09:53.198124 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 841/1097] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:53 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:54.182244 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [req-d3e2df61-4700-4081-98ad-f293092d1586 req-f91bc80a-a67b-46ce-bdf7-e9f9a42e9e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215f0ad3-e8a5-461d-adf8-6f61138cf4d3", "name": "network-vif-deleted", "tag": "c3b20aa5-642c-4aaa-8149-27f7d0cb9d82"}]} {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 06:09:54.191038 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-d3e2df61-4700-4081-98ad-f293092d1586 req-f91bc80a-a67b-46ce-bdf7-e9f9a42e9e63 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:54.191483 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [req-d3e2df61-4700-4081-98ad-f293092d1586 req-f91bc80a-a67b-46ce-bdf7-e9f9a42e9e63 service nova] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:54.203006 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.compute.server_external_events [req-d3e2df61-4700-4081-98ad-f293092d1586 req-f91bc80a-a67b-46ce-bdf7-e9f9a42e9e63 service nova] Creating event network-vif-deleted:c3b20aa5-642c-4aaa-8149-27f7d0cb9d82 for instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 on hv-cinder-85044 Jul 21 06:09:54.207787 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [req-d3e2df61-4700-4081-98ad-f293092d1586 req-f91bc80a-a67b-46ce-bdf7-e9f9a42e9e63 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029234 Jul 21 06:09:54.208387 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 842/1098] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 06:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 06:09:54.215925 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:54.216624 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:54.222962 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:54.223442 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:54.224187 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:54.224615 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:54.242499 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG dbcounter [-] [124328] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 06:09:54.290795 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.policy [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d7bbfba930843cd9782c4bf4931c3b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412742fe621f4e63acb5891ae57a10d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124328) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 06:09:54.298314 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-7721761a-787d-4cae-bc1c-45f12816be98 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 200 len: 1299 microversion: 2.1 time: 0.086762 Jul 21 06:09:54.298870 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 843/1099] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:54 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 06:09:55.319966 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Calling method '>' {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 06:09:55.321150 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.compute.api [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] [instance: 215f0ad3-e8a5-461d-adf8-6f61138cf4d3] Fetching instance by UUID {{(pid=124328) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 06:09:55.328190 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:55.328747 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:55.329623 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 06:09:55.329997 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG oslo_concurrency.lockutils [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Lock "c94c6f16-4900-4da5-aed7-50fb0037da9c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124328) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 06:09:55.343989 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.wsgi [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] HTTP exception thrown: Instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 could not be found. Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Request method failure captured: Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: request: GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 HTTP/1.1 Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept: application/json Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Accept-Encoding: identity Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Connection: close Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Length: 0 Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Content-Type: application/json Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Host: 10.222.0.44 Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Openstack-System-Scope: None Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: User-Agent: python-urllib3/1.26.9 Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Auth-Token: gAAAAABi2O2h8OCab1Dak4Va_Brkm9zQvXRGoaPN0toOpgMVlHgHruWKHfnFp9H4dsSCqcucuuXJ-ajW2DdWowh2pb2gVP4zZbjbqO3Bz0afmyBMS4kWP90t2Pe8Hl5LUP7sfVHvVCgxTvLcJejVYYFcXVg0HijkbisH4nKwVU4Hkxcz17xv9mw Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Id: None Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Domain-Name: None Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Identity-Status: Confirmed Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Is-Admin-Project: True Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Id: default Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Domain-Name: Default Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Id: 412742fe621f4e63acb5891ae57a10d0 Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Project-Name: tempest-VolumesNegativeTest-1953682534 Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Role: member,reader Jul 21 06:09:55.345639 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Roles: member,reader Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/412742fe621f4e63acb5891ae57a10d0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/412742fe621f4e63acb5891ae57a10d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_412742fe621f4e63acb5891ae57a10d0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/412742fe621f4e63acb5891ae57a10d0"}]}] Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant: tempest-VolumesNegativeTest-1953682534 Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Id: 412742fe621f4e63acb5891ae57a10d0 Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-Tenant-Name: tempest-VolumesNegativeTest-1953682534 Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User: tempest-VolumesNegativeTest-1953682534-project Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Id: default Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Domain-Name: Default Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Id: 3d7bbfba930843cd9782c4bf4931c3b1 Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: X-User-Name: tempest-VolumesNegativeTest-1953682534-project Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: method: > Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: exception: Instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 could not be found. Jul 21 06:09:55.347582 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: action_args: {'id': '215f0ad3-e8a5-461d-adf8-6f61138cf4d3'} Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: {{(pid=124328) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 could not be found. Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 06:09:55.348650 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 could not be found. Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 could not be found. Jul 21 06:09:55.350440 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: ERROR nova.api.openstack.wsgi Jul 21 06:09:55.352090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: DEBUG nova.api.openstack.wsgi [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] Returning 404 to user: Instance 215f0ad3-e8a5-461d-adf8-6f61138cf4d3 could not be found. {{(pid=124328) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 06:09:55.352090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO nova.api.openstack.requestlog [None req-88b86997-b8ee-47f2-aa63-4cb8f18c5c68 tempest-VolumesNegativeTest-1953682534 tempest-VolumesNegativeTest-1953682534-project] 10.222.0.44 "GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3" status: 404 len: 111 microversion: 2.1 time: 0.033586 Jul 21 06:09:55.352090 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: [pid: 124328|app: 0|req: 844/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 06:09:55 2022] GET /compute/v2.1/servers/215f0ad3-e8a5-461d-adf8-6f61138cf4d3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 06:11:12.086082 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:11:12.086812 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Thu Jul 21 06:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:12:11.348391 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:12:11.349048 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:12:12.437621 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:12:12.438530 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Thu Jul 21 06:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:12:25.916401 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:12:25.916963 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:12:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:12:33.304254 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:12:33.305364 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Thu Jul 21 06:12:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:14:32.096165 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:14:32.096893 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Thu Jul 21 06:14:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 06:15:31.357747 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:15:31.358392 dv-cinder-850449-1-iscsi devstack@n-api.service[124329]: Thu Jul 21 06:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1785966693 (ip 10.222.0.44) !!! Jul 21 06:15:32.447351 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 06:15:32.447943 dv-cinder-850449-1-iscsi devstack@n-api.service[124328]: Thu Jul 21 06:15:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!